Jun 02 19:59:16.632294 ip-10-0-132-46 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 19:59:16.632305 ip-10-0-132-46 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 19:59:16.632312 ip-10-0-132-46 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 19:59:16.632559 ip-10-0-132-46 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 19:59:28.126965 ip-10-0-132-46 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 19:59:28.126987 ip-10-0-132-46 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 7a026dc450134baea728c66473b9054e -- Jun 02 20:01:45.034789 ip-10-0-132-46 systemd[1]: Starting Kubernetes Kubelet... Jun 02 20:01:45.485131 ip-10-0-132-46 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 20:01:45.485131 ip-10-0-132-46 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 20:01:45.485131 ip-10-0-132-46 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 20:01:45.485131 ip-10-0-132-46 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 20:01:45.485131 ip-10-0-132-46 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 20:01:45.488611 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.488470 2562 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 20:01:45.494284 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494261 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 20:01:45.494284 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494282 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 20:01:45.494284 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494286 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 20:01:45.494284 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494289 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 20:01:45.494284 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494292 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494295 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494298 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494301 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494303 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494306 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494308 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494311 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494314 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494316 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494318 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494321 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494323 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494326 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494328 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494331 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494334 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494336 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494339 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 20:01:45.494493 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494344 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494347 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494349 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494352 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494354 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494357 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494359 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494362 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494364 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494367 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494369 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494371 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494374 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494376 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494379 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494382 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494385 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494387 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494390 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494392 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 20:01:45.494994 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494395 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494398 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494400 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494403 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494408 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494411 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494414 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494417 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494419 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494422 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494424 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494427 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494429 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494432 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494434 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494436 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494439 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494441 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494444 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 20:01:45.495543 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494446 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494449 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494451 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494454 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494470 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494474 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494477 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494479 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494483 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494486 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494488 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494491 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494495 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494500 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494503 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494506 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494510 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494512 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494515 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494518 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 20:01:45.496007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494521 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494523 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494526 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494529 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494914 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494919 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494922 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494925 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494928 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494930 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494933 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494935 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494938 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494940 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494943 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494945 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494948 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494950 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494953 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 20:01:45.496510 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494957 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494960 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494962 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494965 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494967 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494970 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494973 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494975 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494978 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494981 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494983 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494986 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494988 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494991 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494993 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.494997 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495001 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495004 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495007 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 20:01:45.496978 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495009 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495012 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495015 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495018 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495020 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495022 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495025 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495029 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495032 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495035 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495037 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495039 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495042 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495045 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495048 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495051 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495053 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495056 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495058 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495062 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 20:01:45.497445 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495064 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495067 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495069 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495072 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495075 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495078 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495080 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495082 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495085 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495087 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495089 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495092 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495094 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495097 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495099 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495101 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495105 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495107 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495110 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495113 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 20:01:45.497951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495115 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495118 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495120 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495123 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495125 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495128 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495130 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495133 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495135 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495138 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495140 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495142 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495242 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495253 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495262 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495268 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495274 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495278 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495282 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495287 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495290 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 20:01:45.498446 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495293 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495297 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495300 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495303 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495305 2562 flags.go:64] FLAG: --cgroup-root="" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495308 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495311 2562 flags.go:64] FLAG: --client-ca-file="" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495314 2562 flags.go:64] FLAG: --cloud-config="" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495316 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495322 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495326 2562 flags.go:64] FLAG: --cluster-domain="" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495329 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495331 2562 flags.go:64] FLAG: --config-dir="" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495335 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495338 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495347 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495350 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495353 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495356 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495359 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495362 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495365 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495368 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495370 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495375 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 20:01:45.498976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495377 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495380 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495383 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495389 2562 flags.go:64] FLAG: --enable-server="true" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495392 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495397 2562 flags.go:64] FLAG: --event-burst="100" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495400 2562 flags.go:64] FLAG: --event-qps="50" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495403 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495406 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495409 2562 flags.go:64] FLAG: --eviction-hard="" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495412 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495415 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495418 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495421 2562 flags.go:64] FLAG: --eviction-soft="" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495423 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495426 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495430 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495433 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495436 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495439 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495442 2562 flags.go:64] FLAG: --feature-gates="" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495447 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495450 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495453 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495469 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495473 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 02 20:01:45.499616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495476 2562 flags.go:64] FLAG: --help="false" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495478 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-132-46.ec2.internal" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495481 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495484 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495487 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495490 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495493 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495496 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495499 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495501 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495505 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495508 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495511 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495513 2562 flags.go:64] FLAG: --kube-reserved="" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495516 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495519 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495522 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495524 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495527 2562 flags.go:64] FLAG: --lock-file="" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495529 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495532 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495535 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495542 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 20:01:45.500241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495545 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495547 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495551 2562 flags.go:64] FLAG: --logging-format="text" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495554 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495558 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495560 2562 flags.go:64] FLAG: --manifest-url="" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495563 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495567 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495570 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495574 2562 flags.go:64] FLAG: --max-pods="110" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495577 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495580 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495583 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495586 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495589 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495592 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495595 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495603 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495606 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495609 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495612 2562 flags.go:64] FLAG: --pod-cidr="" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495615 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495621 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495625 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 20:01:45.500845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495628 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495631 2562 flags.go:64] FLAG: --port="10250" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495633 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495636 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0572e198e673a5a44" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495639 2562 flags.go:64] FLAG: --qos-reserved="" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495643 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495645 2562 flags.go:64] FLAG: --register-node="true" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495649 2562 flags.go:64] FLAG: --register-schedulable="true" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495652 2562 flags.go:64] FLAG: --register-with-taints="" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495656 2562 flags.go:64] FLAG: --registry-burst="10" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495658 2562 flags.go:64] FLAG: --registry-qps="5" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495661 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495664 2562 flags.go:64] FLAG: --reserved-memory="" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495668 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495671 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495674 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495677 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495680 2562 flags.go:64] FLAG: --runonce="false" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495683 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495686 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495689 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495691 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495694 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495697 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495700 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495704 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 20:01:45.501415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495706 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495709 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495712 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495715 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495719 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495721 2562 flags.go:64] FLAG: --system-cgroups="" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495724 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495730 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495732 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495735 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495739 2562 flags.go:64] FLAG: --tls-min-version="" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495741 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495744 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495748 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495750 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495753 2562 flags.go:64] FLAG: --v="2" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495757 2562 flags.go:64] FLAG: --version="false" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495761 2562 flags.go:64] FLAG: --vmodule="" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495766 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.495769 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495880 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495884 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495887 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495890 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 20:01:45.502084 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495892 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495895 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495897 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495900 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495902 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495904 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495907 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495909 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495912 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495915 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495917 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495920 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495923 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495925 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495928 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495930 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495933 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495935 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495938 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 20:01:45.502676 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495940 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495942 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495946 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495949 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495951 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495955 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495961 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495963 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495966 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495968 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495971 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495974 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495976 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495979 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495981 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495984 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495986 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495989 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495991 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495994 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 20:01:45.503190 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495996 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.495998 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496001 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496003 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496006 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496008 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496012 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496014 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496017 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496019 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496022 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496024 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496027 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496030 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496033 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496036 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496038 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496041 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496045 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496047 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 20:01:45.503712 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496050 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496052 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496055 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496057 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496059 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496062 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496064 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496067 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496069 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496072 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496074 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496076 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496080 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496084 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496087 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496090 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496093 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496095 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496098 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 20:01:45.504216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496101 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 20:01:45.504752 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496104 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 20:01:45.504752 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496106 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 20:01:45.504752 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.496109 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 20:01:45.504752 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.496834 2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 20:01:45.504752 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.503409 2562 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 20:01:45.504752 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.503425 2562 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 20:01:45.504752 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503495 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 20:01:45.504752 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503502 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 20:01:45.504752 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503506 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 20:01:45.504752 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503509 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 20:01:45.504752 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503512 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 20:01:45.504752 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503515 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 20:01:45.504752 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503518 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 20:01:45.504752 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503521 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 20:01:45.504752 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503524 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 20:01:45.504752 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503527 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503530 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503532 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503535 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503538 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503540 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503543 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503546 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503548 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503551 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503553 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503556 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503558 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503561 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503563 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503565 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503568 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503570 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503573 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503575 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 20:01:45.505146 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503578 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503580 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503585 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503587 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503590 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503592 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503596 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503600 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503602 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503605 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503608 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503610 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503612 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503615 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503617 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503620 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503622 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503625 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503627 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503630 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 20:01:45.505652 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503632 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503634 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503637 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503639 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503642 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503644 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503647 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503649 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503652 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503654 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503657 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503659 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503662 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503664 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503667 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503670 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503673 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503676 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503681 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 20:01:45.506145 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503684 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 20:01:45.506658 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503686 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 20:01:45.506658 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503689 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 20:01:45.506658 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503692 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 20:01:45.506658 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503694 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 20:01:45.506658 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503697 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 20:01:45.506658 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503699 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 20:01:45.506658 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503702 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 20:01:45.506658 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503704 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 20:01:45.506658 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503706 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 20:01:45.506658 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503709 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 20:01:45.506658 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503711 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 20:01:45.506658 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503714 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 20:01:45.506658 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503717 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 20:01:45.506658 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503719 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 20:01:45.506658 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503722 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 20:01:45.506658 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503724 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 20:01:45.506658 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503727 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 20:01:45.507082 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.503732 2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 20:01:45.507082 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503832 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 20:01:45.507082 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503837 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 20:01:45.507082 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503840 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 20:01:45.507082 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503843 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 20:01:45.507082 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503845 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 20:01:45.507082 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503848 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 20:01:45.507082 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503851 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 20:01:45.507082 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503853 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 20:01:45.507082 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503856 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 20:01:45.507082 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503859 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 20:01:45.507082 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503862 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 20:01:45.507082 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503865 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 20:01:45.507082 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503867 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 20:01:45.507082 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503870 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503874 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503877 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503880 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503882 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503885 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503887 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503889 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503892 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503894 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503896 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503899 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503903 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503906 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503910 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503912 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503915 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503917 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503920 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 20:01:45.507516 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503923 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503926 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503929 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503931 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503933 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503936 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503938 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503941 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503943 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503946 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503949 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503952 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503954 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503957 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503959 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503961 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503964 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503967 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503969 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503972 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 20:01:45.507967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503974 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503976 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503979 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503981 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503984 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503986 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503988 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503991 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503993 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503995 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.503998 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504000 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504002 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504005 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504007 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504010 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504013 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504015 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504017 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504020 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 20:01:45.508450 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504022 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 20:01:45.508961 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504025 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 20:01:45.508961 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504027 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 20:01:45.508961 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504030 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 20:01:45.508961 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504032 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 20:01:45.508961 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504035 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 20:01:45.508961 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504037 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 20:01:45.508961 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504040 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 20:01:45.508961 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504042 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 20:01:45.508961 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504045 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 20:01:45.508961 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504047 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 20:01:45.508961 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504049 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 20:01:45.508961 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504052 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 20:01:45.508961 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:45.504054 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 20:01:45.508961 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.504059 2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 20:01:45.508961 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.504745 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 20:01:45.509328 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.508180 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 20:01:45.509328 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.509036 2562 server.go:1019] "Starting client certificate rotation" Jun 02 20:01:45.509328 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.509137 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 20:01:45.509328 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.509166 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 20:01:45.533722 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.533703 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 20:01:45.535871 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.535855 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 20:01:45.544648 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.544629 2562 log.go:25] "Validated CRI v1 runtime API" Jun 02 20:01:45.549923 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.549901 2562 log.go:25] "Validated CRI v1 image API" Jun 02 20:01:45.552178 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.552155 2562 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 20:01:45.557131 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.557104 2562 fs.go:135] Filesystem UUIDs: map[070e6086-67b2-4246-8b9f-ab9322079bc0:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a2e051bc-4d9f-474f-928d-ca0ae82c38e0:/dev/nvme0n1p3] Jun 02 20:01:45.557189 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.557131 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 20:01:45.561579 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.561454 2562 manager.go:217] Machine: {Timestamp:2026-06-02 20:01:45.560981199 +0000 UTC m=+0.406267158 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110901 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25e49eb4d147dc885921f945976da3 SystemUUID:ec25e49e-b4d1-47dc-8859-21f945976da3 BootID:7a026dc4-5013-4bae-a728-c66473b9054e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a8:cf:42:57:f1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a8:cf:42:57:f1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:30:9b:8b:fa:b8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 20:01:45.561579 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.561574 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 20:01:45.561694 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.561650 2562 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 20:01:45.563325 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.563303 2562 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 20:01:45.563479 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.563330 2562 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-46.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 20:01:45.563531 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.563489 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 20:01:45.563531 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.563498 2562 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 20:01:45.563531 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.563506 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 20:01:45.563531 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.563522 2562 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 20:01:45.564687 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.564677 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 02 20:01:45.564791 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.564783 2562 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 20:01:45.567230 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.567219 2562 kubelet.go:491] "Attempting to sync node with API server" Jun 02 20:01:45.567276 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.567234 2562 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 20:01:45.567929 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.567920 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 20:01:45.567962 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.567933 2562 kubelet.go:397] "Adding apiserver pod source" Jun 02 20:01:45.567962 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.567942 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 20:01:45.568625 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.568476 2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 20:01:45.569208 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.569194 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 20:01:45.569269 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.569214 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 20:01:45.576615 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.576592 2562 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 20:01:45.578288 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.578275 2562 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 20:01:45.580247 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.580230 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 20:01:45.580306 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.580257 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 20:01:45.580306 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.580267 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 20:01:45.580306 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.580275 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 20:01:45.580306 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.580286 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 20:01:45.580306 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.580294 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 20:01:45.580306 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.580302 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 20:01:45.580489 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.580309 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 20:01:45.580489 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.580322 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 20:01:45.580489 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.580332 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 20:01:45.580489 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.580327 2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 20:01:45.580489 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.580344 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 20:01:45.580489 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.580324 2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-46.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 20:01:45.580489 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.580354 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 20:01:45.581916 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.581904 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 20:01:45.581916 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.581916 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 20:01:45.585511 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.585491 2562 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 20:01:45.585599 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.585545 2562 server.go:1295] "Started kubelet" Jun 02 20:01:45.586547 ip-10-0-132-46 systemd[1]: Started Kubernetes Kubelet. Jun 02 20:01:45.587731 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.587559 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 20:01:45.587731 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.587695 2562 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 20:01:45.587846 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.587761 2562 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 20:01:45.588730 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.588716 2562 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 20:01:45.590533 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.590520 2562 server.go:317] "Adding debug handlers to kubelet server" Jun 02 20:01:45.595861 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.595836 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 20:01:45.595964 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.595865 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 20:01:45.595964 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.595901 2562 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 20:01:45.595964 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.595913 2562 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 20:01:45.596098 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.596026 2562 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 20:01:45.596098 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.596091 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 02 20:01:45.596098 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.596098 2562 reconciler.go:26] "Reconciler: start to sync state" Jun 02 20:01:45.596743 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.596664 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-46.ec2.internal\" not found" Jun 02 20:01:45.596743 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.596714 2562 factory.go:55] Registering systemd factory Jun 02 20:01:45.596743 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.596730 2562 factory.go:223] Registration of the systemd container factory successfully Jun 02 20:01:45.596963 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.596949 2562 factory.go:153] Registering CRI-O factory Jun 02 20:01:45.597019 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.596967 2562 factory.go:223] Registration of the crio container factory successfully Jun 02 20:01:45.597019 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.597017 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 20:01:45.597150 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.597041 2562 factory.go:103] Registering Raw factory Jun 02 20:01:45.597150 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.597058 2562 manager.go:1196] Started watching for new ooms in manager Jun 02 20:01:45.597437 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.597423 2562 manager.go:319] Starting recovery of all containers Jun 02 20:01:45.600097 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.600072 2562 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 20:01:45.601260 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.601234 2562 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-46.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 20:01:45.601343 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.601283 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-46.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 20:01:45.602331 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.601395 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-46.ec2.internal.18b55c1c98b184fe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-46.ec2.internal,UID:ip-10-0-132-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-46.ec2.internal,},FirstTimestamp:2026-06-02 20:01:45.58550963 +0000 UTC m=+0.430795594,LastTimestamp:2026-06-02 20:01:45.58550963 +0000 UTC m=+0.430795594,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-46.ec2.internal,}" Jun 02 20:01:45.602425 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.602403 2562 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 20:01:45.606691 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.606676 2562 manager.go:324] Recovery completed Jun 02 20:01:45.607893 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.607864 2562 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 02 20:01:45.610605 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.610591 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 20:01:45.612498 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.612454 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeHasSufficientMemory" Jun 02 20:01:45.612561 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.612517 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 20:01:45.612561 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.612531 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeHasSufficientPID" Jun 02 20:01:45.613071 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.613058 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 20:01:45.613071 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.613068 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 20:01:45.613170 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.613082 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 02 20:01:45.615122 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.615111 2562 policy_none.go:49] "None policy: Start" Jun 02 20:01:45.615160 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.615138 2562 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 20:01:45.615160 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.615151 2562 state_mem.go:35] "Initializing new in-memory state store" Jun 02 20:01:45.615236 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.615148 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-46.ec2.internal.18b55c1c9a4d5586 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-46.ec2.internal,UID:ip-10-0-132-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-46.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-46.ec2.internal,},FirstTimestamp:2026-06-02 20:01:45.61249831 +0000 UTC m=+0.457784270,LastTimestamp:2026-06-02 20:01:45.61249831 +0000 UTC m=+0.457784270,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-46.ec2.internal,}" Jun 02 20:01:45.629632 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.629572 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-46.ec2.internal.18b55c1c9a4db6d2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-46.ec2.internal,UID:ip-10-0-132-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-46.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-46.ec2.internal,},FirstTimestamp:2026-06-02 20:01:45.612523218 +0000 UTC m=+0.457809178,LastTimestamp:2026-06-02 20:01:45.612523218 +0000 UTC m=+0.457809178,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-46.ec2.internal,}" Jun 02 20:01:45.639428 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.639344 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-46.ec2.internal.18b55c1c9a4de9d5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-46.ec2.internal,UID:ip-10-0-132-46.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-46.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-46.ec2.internal,},FirstTimestamp:2026-06-02 20:01:45.612536277 +0000 UTC m=+0.457822237,LastTimestamp:2026-06-02 20:01:45.612536277 +0000 UTC m=+0.457822237,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-46.ec2.internal,}" Jun 02 20:01:45.645843 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.645824 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pb5c6" Jun 02 20:01:45.651285 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.651257 2562 manager.go:341] "Starting Device Plugin manager" Jun 02 20:01:45.651376 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.651290 2562 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 20:01:45.651376 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.651304 2562 server.go:85] "Starting device plugin registration server" Jun 02 20:01:45.652316 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.651568 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 20:01:45.652316 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.651581 2562 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 20:01:45.652316 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.651792 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 20:01:45.652316 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.651864 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 20:01:45.652316 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.651872 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 20:01:45.652738 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.652423 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 20:01:45.652738 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.652495 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-46.ec2.internal\" not found" Jun 02 20:01:45.670104 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.654126 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pb5c6" Jun 02 20:01:45.691650 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.691614 2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 20:01:45.693052 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.693037 2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 20:01:45.693563 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.693545 2562 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 20:01:45.693665 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.693584 2562 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 20:01:45.693665 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.693592 2562 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 20:01:45.693665 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.693634 2562 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 20:01:45.698198 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.698182 2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 20:01:45.752769 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.752691 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 20:01:45.753649 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.753630 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeHasSufficientMemory" Jun 02 20:01:45.753779 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.753664 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 20:01:45.753779 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.753679 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeHasSufficientPID" Jun 02 20:01:45.753779 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.753721 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-46.ec2.internal" Jun 02 20:01:45.761590 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.761573 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-46.ec2.internal" Jun 02 20:01:45.761658 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.761597 2562 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-46.ec2.internal\": node \"ip-10-0-132-46.ec2.internal\" not found" Jun 02 20:01:45.790160 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.790135 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-46.ec2.internal\" not found" Jun 02 20:01:45.794746 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.794725 2562 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-46.ec2.internal"] Jun 02 20:01:45.794813 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.794798 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 20:01:45.795745 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.795732 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeHasSufficientMemory" Jun 02 20:01:45.795820 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.795759 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 20:01:45.795820 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.795770 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeHasSufficientPID" Jun 02 20:01:45.797281 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.797268 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 20:01:45.797448 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.797431 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal" Jun 02 20:01:45.797547 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.797477 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 20:01:45.797980 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.797965 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeHasSufficientMemory" Jun 02 20:01:45.798055 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.797996 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 20:01:45.798055 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.798011 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeHasSufficientPID" Jun 02 20:01:45.798381 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.798364 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeHasSufficientMemory" Jun 02 20:01:45.798437 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.798396 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 20:01:45.798437 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.798410 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeHasSufficientPID" Jun 02 20:01:45.799829 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.799812 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-46.ec2.internal" Jun 02 20:01:45.799918 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.799845 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 20:01:45.800555 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.800540 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeHasSufficientMemory" Jun 02 20:01:45.800625 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.800563 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 20:01:45.800625 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.800573 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeHasSufficientPID" Jun 02 20:01:45.824017 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.824000 2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-46.ec2.internal\" not found" node="ip-10-0-132-46.ec2.internal" Jun 02 20:01:45.827349 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.827333 2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-46.ec2.internal\" not found" node="ip-10-0-132-46.ec2.internal" Jun 02 20:01:45.890356 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.890324 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-46.ec2.internal\" not found" Jun 02 20:01:45.897910 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.897881 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/54102e30a1067a72b283ba73b26bd06e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal\" (UID: \"54102e30a1067a72b283ba73b26bd06e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal" Jun 02 20:01:45.898006 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.897920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54102e30a1067a72b283ba73b26bd06e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal\" (UID: \"54102e30a1067a72b283ba73b26bd06e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal" Jun 02 20:01:45.898006 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.897965 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2c4fe31db52904cda32b7bc3da196d3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-46.ec2.internal\" (UID: \"d2c4fe31db52904cda32b7bc3da196d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-46.ec2.internal" Jun 02 20:01:45.990949 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:45.990910 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-46.ec2.internal\" not found" Jun 02 20:01:45.998276 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.998249 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/54102e30a1067a72b283ba73b26bd06e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal\" (UID: \"54102e30a1067a72b283ba73b26bd06e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal" Jun 02 20:01:45.998371 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.998290 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54102e30a1067a72b283ba73b26bd06e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal\" (UID: \"54102e30a1067a72b283ba73b26bd06e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal" Jun 02 20:01:45.998371 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.998313 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2c4fe31db52904cda32b7bc3da196d3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-46.ec2.internal\" (UID: \"d2c4fe31db52904cda32b7bc3da196d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-46.ec2.internal" Jun 02 20:01:45.998371 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.998352 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2c4fe31db52904cda32b7bc3da196d3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-46.ec2.internal\" (UID: \"d2c4fe31db52904cda32b7bc3da196d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-46.ec2.internal" Jun 02 20:01:45.998499 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.998365 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/54102e30a1067a72b283ba73b26bd06e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal\" (UID: \"54102e30a1067a72b283ba73b26bd06e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal" Jun 02 20:01:45.998499 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:45.998360 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54102e30a1067a72b283ba73b26bd06e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal\" (UID: \"54102e30a1067a72b283ba73b26bd06e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal" Jun 02 20:01:46.091710 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:46.091635 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-46.ec2.internal\" not found" Jun 02 20:01:46.126106 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.126075 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal" Jun 02 20:01:46.130853 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.130839 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-46.ec2.internal" Jun 02 20:01:46.192436 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:46.192394 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-46.ec2.internal\" not found" Jun 02 20:01:46.292941 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:46.292909 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-46.ec2.internal\" not found" Jun 02 20:01:46.393500 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:46.393383 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-46.ec2.internal\" not found" Jun 02 20:01:46.494005 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:46.493971 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-46.ec2.internal\" not found" Jun 02 20:01:46.509437 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.509405 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 20:01:46.509605 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.509585 2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 20:01:46.525677 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.525650 2562 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 20:01:46.568651 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.568622 2562 apiserver.go:52] "Watching apiserver" Jun 02 20:01:46.576647 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.576626 2562 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 20:01:46.579037 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.579005 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-fflxg","openshift-network-operator/iptables-alerter-7pmg9","openshift-ovn-kubernetes/ovnkube-node-qwd9g","openshift-dns/node-resolver-wc9fq","openshift-image-registry/node-ca-vszcp","openshift-multus/multus-additional-cni-plugins-vlr5w","openshift-multus/multus-mfp9l","kube-system/konnectivity-agent-pwg4k","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg","openshift-cluster-node-tuning-operator/tuned-bj5hn","openshift-multus/network-metrics-daemon-dv4rg"] Jun 02 20:01:46.580888 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.580871 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:01:46.580972 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:46.580955 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflxg" podUID="3c8a3790-7924-4560-8de5-36ab2806c8a2" Jun 02 20:01:46.582201 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.582187 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.583034 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.583002 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wc9fq" Jun 02 20:01:46.584169 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.584150 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.584679 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.584661 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 20:01:46.584781 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.584698 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 20:01:46.584781 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.584699 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 20:01:46.584942 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.584928 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 20:01:46.585043 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.585026 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gpc8z\"" Jun 02 20:01:46.585094 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.585040 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 20:01:46.585290 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.585272 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 20:01:46.585351 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.585326 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 20:01:46.585351 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.585281 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 20:01:46.585532 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.585519 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mnh5x\"" Jun 02 20:01:46.586165 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.586153 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.587365 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.587350 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pwg4k" Jun 02 20:01:46.587490 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.587476 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.587940 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.587912 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 20:01:46.588035 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.587995 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 20:01:46.588169 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.588153 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 20:01:46.588380 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.588364 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 20:01:46.588693 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.588678 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 20:01:46.588768 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.588707 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:01:46.588828 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:46.588767 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:01:46.589771 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.589756 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sqkhk\"" Jun 02 20:01:46.589966 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.589953 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7pmg9" Jun 02 20:01:46.591553 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.591538 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vszcp" Jun 02 20:01:46.592813 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.592793 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.592920 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.592900 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 20:01:46.593237 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.593219 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 20:01:46.593336 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.593244 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 20:01:46.593548 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.593527 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r6d6l\"" Jun 02 20:01:46.593548 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.593541 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 20:01:46.593696 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.593555 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6vvck\"" Jun 02 20:01:46.593696 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.593541 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 20:01:46.593696 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.593610 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 20:01:46.593811 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.593795 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 20:01:46.593867 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.593851 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 20:01:46.593912 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.593865 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 20:01:46.593954 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.593933 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6rq4d\"" Jun 02 20:01:46.594010 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.593967 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 20:01:46.594059 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.594034 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 20:01:46.594213 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.594200 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zvp99\"" Jun 02 20:01:46.594411 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.594395 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kvrlp\"" Jun 02 20:01:46.594509 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.594455 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 20:01:46.594791 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.594772 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nwnj8\"" Jun 02 20:01:46.594954 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.594937 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 20:01:46.598291 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.596195 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 20:01:46.598291 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.596881 2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-46.ec2.internal" Jun 02 20:01:46.598291 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.598042 2562 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 20:01:46.598555 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.598539 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 20:01:46.601402 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601382 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-multus-socket-dir-parent\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.601522 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601407 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1e99a4e-cb86-4060-a831-fb5113477814-system-cni-dir\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.601522 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601425 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpkl6\" (UniqueName: \"kubernetes.io/projected/b3b653aa-519a-48d7-8d68-f907db391e06-kube-api-access-jpkl6\") pod \"network-metrics-daemon-dv4rg\" (UID: \"b3b653aa-519a-48d7-8d68-f907db391e06\") " pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:01:46.601522 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601441 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-tuned\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.601684 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601534 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13d85ccb-6812-49fd-a979-ca81ba04184d-ovn-node-metrics-cert\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.601684 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601578 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-host-var-lib-kubelet\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.601684 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601603 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-etc-kubernetes\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.601684 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601629 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj659\" (UniqueName: \"kubernetes.io/projected/b927495c-7a28-4a3d-aa2d-4517632b4814-kube-api-access-sj659\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.601684 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601656 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2ae75b6b-e677-4ee1-99be-e5d2712e0482-device-dir\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.601684 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601679 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/18564f1d-8be6-41ef-ac3b-7fe898a2d2b8-iptables-alerter-script\") pod \"iptables-alerter-7pmg9\" (UID: \"18564f1d-8be6-41ef-ac3b-7fe898a2d2b8\") " pod="openshift-network-operator/iptables-alerter-7pmg9" Jun 02 20:01:46.601957 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601704 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-log-socket\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.601957 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601732 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13d85ccb-6812-49fd-a979-ca81ba04184d-ovnkube-script-lib\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.601957 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601759 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b927495c-7a28-4a3d-aa2d-4517632b4814-cni-binary-copy\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.601957 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601774 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-multus-conf-dir\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.601957 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601788 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1e99a4e-cb86-4060-a831-fb5113477814-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.601957 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601822 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-var-lib-kubelet\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.601957 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601847 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-run-systemd\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.601957 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601869 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-etc-openvswitch\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.601957 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601893 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-run-ovn-kubernetes\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.601957 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601915 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-host-var-lib-cni-bin\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.601957 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601939 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-hostroot\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.602404 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601970 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snq22\" (UniqueName: \"kubernetes.io/projected/3550fef2-7bdf-4f39-b59b-38be4c78fc52-kube-api-access-snq22\") pod \"node-resolver-wc9fq\" (UID: \"3550fef2-7bdf-4f39-b59b-38be4c78fc52\") " pod="openshift-dns/node-resolver-wc9fq" Jun 02 20:01:46.602404 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.601995 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1e99a4e-cb86-4060-a831-fb5113477814-cni-binary-copy\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.602404 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602018 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/089e630c-97ec-48b9-9300-ff9c367f88bf-tmp\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.602404 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602049 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-host-var-lib-cni-multus\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.602404 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602080 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94qkm\" (UniqueName: \"kubernetes.io/projected/a92766b7-de27-4a9c-8ec8-f55cbc5b26b8-kube-api-access-94qkm\") pod \"node-ca-vszcp\" (UID: \"a92766b7-de27-4a9c-8ec8-f55cbc5b26b8\") " pod="openshift-image-registry/node-ca-vszcp" Jun 02 20:01:46.602404 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602102 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1e99a4e-cb86-4060-a831-fb5113477814-cnibin\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.602404 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602129 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs\") pod \"network-metrics-daemon-dv4rg\" (UID: \"b3b653aa-519a-48d7-8d68-f907db391e06\") " pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:01:46.602404 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602155 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-run\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.602404 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602179 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13d85ccb-6812-49fd-a979-ca81ba04184d-ovnkube-config\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.602404 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rks7\" (UniqueName: \"kubernetes.io/projected/13d85ccb-6812-49fd-a979-ca81ba04184d-kube-api-access-5rks7\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.602404 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602211 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-cni-bin\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.602404 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602224 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2ae75b6b-e677-4ee1-99be-e5d2712e0482-etc-selinux\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.602404 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602243 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2ae75b6b-e677-4ee1-99be-e5d2712e0482-sys-fs\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.602404 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602262 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a92766b7-de27-4a9c-8ec8-f55cbc5b26b8-host\") pod \"node-ca-vszcp\" (UID: \"a92766b7-de27-4a9c-8ec8-f55cbc5b26b8\") " pod="openshift-image-registry/node-ca-vszcp" Jun 02 20:01:46.602404 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602276 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3550fef2-7bdf-4f39-b59b-38be4c78fc52-hosts-file\") pod \"node-resolver-wc9fq\" (UID: \"3550fef2-7bdf-4f39-b59b-38be4c78fc52\") " pod="openshift-dns/node-resolver-wc9fq" Jun 02 20:01:46.602404 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602306 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-modprobe-d\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.603097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602333 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-systemd\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.603097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602362 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-multus-cni-dir\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.603097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602384 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-cnibin\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.603097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602410 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-os-release\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.603097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602432 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-slash\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.603097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602473 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-var-lib-openvswitch\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.603097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602496 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13d85ccb-6812-49fd-a979-ca81ba04184d-env-overrides\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.603097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-sys\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.603097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602537 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-host\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.603097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602561 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-run-openvswitch\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.603097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602587 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.603097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2cfe96cc-8d38-4346-81ab-42172f429770-agent-certs\") pod \"konnectivity-agent-pwg4k\" (UID: \"2cfe96cc-8d38-4346-81ab-42172f429770\") " pod="kube-system/konnectivity-agent-pwg4k" Jun 02 20:01:46.603097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602643 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2ae75b6b-e677-4ee1-99be-e5d2712e0482-socket-dir\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.603097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602666 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1e99a4e-cb86-4060-a831-fb5113477814-os-release\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.603097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602686 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-host-run-k8s-cni-cncf-io\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.603097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602708 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b927495c-7a28-4a3d-aa2d-4517632b4814-multus-daemon-config\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.603097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602763 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2cfe96cc-8d38-4346-81ab-42172f429770-konnectivity-ca\") pod \"konnectivity-agent-pwg4k\" (UID: \"2cfe96cc-8d38-4346-81ab-42172f429770\") " pod="kube-system/konnectivity-agent-pwg4k" Jun 02 20:01:46.603656 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602803 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18564f1d-8be6-41ef-ac3b-7fe898a2d2b8-host-slash\") pod \"iptables-alerter-7pmg9\" (UID: \"18564f1d-8be6-41ef-ac3b-7fe898a2d2b8\") " pod="openshift-network-operator/iptables-alerter-7pmg9" Jun 02 20:01:46.603656 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602841 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f1e99a4e-cb86-4060-a831-fb5113477814-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.603656 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602872 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-kubelet\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.603656 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602894 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-kubernetes\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.603656 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602926 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v46zz\" (UniqueName: \"kubernetes.io/projected/089e630c-97ec-48b9-9300-ff9c367f88bf-kube-api-access-v46zz\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.603656 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-run-netns\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.603656 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.602982 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2ae75b6b-e677-4ee1-99be-e5d2712e0482-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.603656 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603021 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7brkd\" (UniqueName: \"kubernetes.io/projected/f1e99a4e-cb86-4060-a831-fb5113477814-kube-api-access-7brkd\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.603656 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603054 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-sysctl-d\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.603656 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603081 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-sysctl-conf\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.603656 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603105 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-systemd-units\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.603656 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2ae75b6b-e677-4ee1-99be-e5d2712e0482-registration-dir\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.603656 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603173 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk9ms\" (UniqueName: \"kubernetes.io/projected/2ae75b6b-e677-4ee1-99be-e5d2712e0482-kube-api-access-qk9ms\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.603656 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603200 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a92766b7-de27-4a9c-8ec8-f55cbc5b26b8-serviceca\") pod \"node-ca-vszcp\" (UID: \"a92766b7-de27-4a9c-8ec8-f55cbc5b26b8\") " pod="openshift-image-registry/node-ca-vszcp" Jun 02 20:01:46.603656 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603221 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxxfb\" (UniqueName: \"kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb\") pod \"network-check-target-fflxg\" (UID: \"3c8a3790-7924-4560-8de5-36ab2806c8a2\") " pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:01:46.603656 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603237 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3550fef2-7bdf-4f39-b59b-38be4c78fc52-tmp-dir\") pod \"node-resolver-wc9fq\" (UID: \"3550fef2-7bdf-4f39-b59b-38be4c78fc52\") " pod="openshift-dns/node-resolver-wc9fq" Jun 02 20:01:46.604131 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603252 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-sysconfig\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.604131 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-host-run-netns\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.604131 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603282 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-host-run-multus-certs\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.604131 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603298 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94bx2\" (UniqueName: \"kubernetes.io/projected/18564f1d-8be6-41ef-ac3b-7fe898a2d2b8-kube-api-access-94bx2\") pod \"iptables-alerter-7pmg9\" (UID: \"18564f1d-8be6-41ef-ac3b-7fe898a2d2b8\") " pod="openshift-network-operator/iptables-alerter-7pmg9" Jun 02 20:01:46.604131 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603313 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f1e99a4e-cb86-4060-a831-fb5113477814-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.604131 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603327 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-lib-modules\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.604131 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603354 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-run-ovn\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.604131 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603380 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-node-log\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.604131 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603395 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-cni-netd\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.604131 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.603416 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-system-cni-dir\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.606083 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.606061 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 20:01:46.606162 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.606134 2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal" Jun 02 20:01:46.606295 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.606278 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-46.ec2.internal"] Jun 02 20:01:46.607841 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.607821 2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 20:01:46.620669 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.620653 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 20:01:46.620826 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.620702 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal"] Jun 02 20:01:46.636993 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.636969 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9vzmv" Jun 02 20:01:46.647593 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.647573 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9vzmv" Jun 02 20:01:46.656130 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.656094 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 19:56:45 +0000 UTC" deadline="2028-01-25 13:21:49.582497804 +0000 UTC" Jun 02 20:01:46.656130 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.656129 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14441h20m2.926372617s" Jun 02 20:01:46.704577 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704555 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1e99a4e-cb86-4060-a831-fb5113477814-cni-binary-copy\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.704690 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704582 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/089e630c-97ec-48b9-9300-ff9c367f88bf-tmp\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.704690 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704599 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-host-var-lib-cni-multus\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.704690 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704615 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-94qkm\" (UniqueName: \"kubernetes.io/projected/a92766b7-de27-4a9c-8ec8-f55cbc5b26b8-kube-api-access-94qkm\") pod \"node-ca-vszcp\" (UID: \"a92766b7-de27-4a9c-8ec8-f55cbc5b26b8\") " pod="openshift-image-registry/node-ca-vszcp" Jun 02 20:01:46.704690 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704628 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1e99a4e-cb86-4060-a831-fb5113477814-cnibin\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.704690 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704651 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs\") pod \"network-metrics-daemon-dv4rg\" (UID: \"b3b653aa-519a-48d7-8d68-f907db391e06\") " pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:01:46.704690 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704672 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-run\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.704984 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704692 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13d85ccb-6812-49fd-a979-ca81ba04184d-ovnkube-config\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.704984 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704718 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5rks7\" (UniqueName: \"kubernetes.io/projected/13d85ccb-6812-49fd-a979-ca81ba04184d-kube-api-access-5rks7\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.704984 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704723 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-host-var-lib-cni-multus\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.704984 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704735 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1e99a4e-cb86-4060-a831-fb5113477814-cnibin\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.704984 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704742 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-cni-bin\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.704984 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704797 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2ae75b6b-e677-4ee1-99be-e5d2712e0482-etc-selinux\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.704984 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704825 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2ae75b6b-e677-4ee1-99be-e5d2712e0482-sys-fs\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.704984 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704849 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a92766b7-de27-4a9c-8ec8-f55cbc5b26b8-host\") pod \"node-ca-vszcp\" (UID: \"a92766b7-de27-4a9c-8ec8-f55cbc5b26b8\") " pod="openshift-image-registry/node-ca-vszcp" Jun 02 20:01:46.704984 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704875 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3550fef2-7bdf-4f39-b59b-38be4c78fc52-hosts-file\") pod \"node-resolver-wc9fq\" (UID: \"3550fef2-7bdf-4f39-b59b-38be4c78fc52\") " pod="openshift-dns/node-resolver-wc9fq" Jun 02 20:01:46.704984 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704900 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-modprobe-d\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.704984 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704927 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-systemd\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.704984 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704952 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-multus-cni-dir\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.704984 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704975 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-cnibin\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.705642 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704986 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 20:01:46.705642 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.704998 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-os-release\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.705642 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705026 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-slash\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.705642 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705051 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-var-lib-openvswitch\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.705642 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705078 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13d85ccb-6812-49fd-a979-ca81ba04184d-env-overrides\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.705642 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705102 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-sys\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.705642 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705127 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-host\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.705642 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705151 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-run-openvswitch\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.705642 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705178 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.705642 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705213 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2cfe96cc-8d38-4346-81ab-42172f429770-agent-certs\") pod \"konnectivity-agent-pwg4k\" (UID: \"2cfe96cc-8d38-4346-81ab-42172f429770\") " pod="kube-system/konnectivity-agent-pwg4k" Jun 02 20:01:46.705642 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705240 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2ae75b6b-e677-4ee1-99be-e5d2712e0482-socket-dir\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.705642 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705264 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1e99a4e-cb86-4060-a831-fb5113477814-os-release\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.705642 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705291 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-host-run-k8s-cni-cncf-io\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.705642 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705319 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b927495c-7a28-4a3d-aa2d-4517632b4814-multus-daemon-config\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.705642 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705346 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2cfe96cc-8d38-4346-81ab-42172f429770-konnectivity-ca\") pod \"konnectivity-agent-pwg4k\" (UID: \"2cfe96cc-8d38-4346-81ab-42172f429770\") " pod="kube-system/konnectivity-agent-pwg4k" Jun 02 20:01:46.705642 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705372 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18564f1d-8be6-41ef-ac3b-7fe898a2d2b8-host-slash\") pod \"iptables-alerter-7pmg9\" (UID: \"18564f1d-8be6-41ef-ac3b-7fe898a2d2b8\") " pod="openshift-network-operator/iptables-alerter-7pmg9" Jun 02 20:01:46.705642 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705398 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f1e99a4e-cb86-4060-a831-fb5113477814-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.705642 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705402 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a92766b7-de27-4a9c-8ec8-f55cbc5b26b8-host\") pod \"node-ca-vszcp\" (UID: \"a92766b7-de27-4a9c-8ec8-f55cbc5b26b8\") " pod="openshift-image-registry/node-ca-vszcp" Jun 02 20:01:46.706380 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705424 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-kubelet\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.706380 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705449 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-kubernetes\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.706380 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705474 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-cni-bin\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.706380 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705506 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v46zz\" (UniqueName: \"kubernetes.io/projected/089e630c-97ec-48b9-9300-ff9c367f88bf-kube-api-access-v46zz\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.706380 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705540 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2ae75b6b-e677-4ee1-99be-e5d2712e0482-etc-selinux\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.706380 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705543 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-run-netns\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.706380 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705579 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2ae75b6b-e677-4ee1-99be-e5d2712e0482-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.706380 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705597 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2ae75b6b-e677-4ee1-99be-e5d2712e0482-sys-fs\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.706380 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705611 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7brkd\" (UniqueName: \"kubernetes.io/projected/f1e99a4e-cb86-4060-a831-fb5113477814-kube-api-access-7brkd\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.706380 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.705638 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-sysctl-d\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.706380 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.706121 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-host-run-k8s-cni-cncf-io\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.706380 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.706176 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-sysctl-conf\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.707311 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.706396 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-kubelet\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.707311 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.706507 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-kubernetes\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.707311 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.706528 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1e99a4e-cb86-4060-a831-fb5113477814-cni-binary-copy\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.707311 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.706596 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-run-netns\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.707311 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.706671 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2ae75b6b-e677-4ee1-99be-e5d2712e0482-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.707311 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.706931 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-sysctl-d\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.707311 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707013 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2ae75b6b-e677-4ee1-99be-e5d2712e0482-socket-dir\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.707311 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707016 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1e99a4e-cb86-4060-a831-fb5113477814-os-release\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.707311 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707061 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18564f1d-8be6-41ef-ac3b-7fe898a2d2b8-host-slash\") pod \"iptables-alerter-7pmg9\" (UID: \"18564f1d-8be6-41ef-ac3b-7fe898a2d2b8\") " pod="openshift-network-operator/iptables-alerter-7pmg9" Jun 02 20:01:46.707311 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707100 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-var-lib-openvswitch\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.707311 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707170 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3550fef2-7bdf-4f39-b59b-38be4c78fc52-hosts-file\") pod \"node-resolver-wc9fq\" (UID: \"3550fef2-7bdf-4f39-b59b-38be4c78fc52\") " pod="openshift-dns/node-resolver-wc9fq" Jun 02 20:01:46.707311 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707229 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-modprobe-d\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.707311 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707269 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-systemd\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.707908 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707331 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-multus-cni-dir\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.707908 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707417 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-cnibin\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.707908 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707491 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-os-release\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.707908 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707536 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-slash\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.707908 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707571 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-run-openvswitch\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.707908 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707659 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-sys\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.707908 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707679 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13d85ccb-6812-49fd-a979-ca81ba04184d-ovnkube-config\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.707908 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707734 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-host\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.707908 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707774 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.707908 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707778 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-sysctl-conf\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.707908 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707827 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-systemd-units\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.707908 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707859 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2ae75b6b-e677-4ee1-99be-e5d2712e0482-registration-dir\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.707908 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707889 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qk9ms\" (UniqueName: \"kubernetes.io/projected/2ae75b6b-e677-4ee1-99be-e5d2712e0482-kube-api-access-qk9ms\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.707908 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707897 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13d85ccb-6812-49fd-a979-ca81ba04184d-env-overrides\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.708667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707919 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a92766b7-de27-4a9c-8ec8-f55cbc5b26b8-serviceca\") pod \"node-ca-vszcp\" (UID: \"a92766b7-de27-4a9c-8ec8-f55cbc5b26b8\") " pod="openshift-image-registry/node-ca-vszcp" Jun 02 20:01:46.708667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707950 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxfb\" (UniqueName: \"kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb\") pod \"network-check-target-fflxg\" (UID: \"3c8a3790-7924-4560-8de5-36ab2806c8a2\") " pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:01:46.708667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707975 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3550fef2-7bdf-4f39-b59b-38be4c78fc52-tmp-dir\") pod \"node-resolver-wc9fq\" (UID: \"3550fef2-7bdf-4f39-b59b-38be4c78fc52\") " pod="openshift-dns/node-resolver-wc9fq" Jun 02 20:01:46.708667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708004 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-sysconfig\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.708667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708034 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-host-run-netns\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.708667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708063 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-host-run-multus-certs\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.708667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708096 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-94bx2\" (UniqueName: \"kubernetes.io/projected/18564f1d-8be6-41ef-ac3b-7fe898a2d2b8-kube-api-access-94bx2\") pod \"iptables-alerter-7pmg9\" (UID: \"18564f1d-8be6-41ef-ac3b-7fe898a2d2b8\") " pod="openshift-network-operator/iptables-alerter-7pmg9" Jun 02 20:01:46.708667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708118 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/089e630c-97ec-48b9-9300-ff9c367f88bf-tmp\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.708667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708122 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f1e99a4e-cb86-4060-a831-fb5113477814-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.708667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708186 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-lib-modules\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.708667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708220 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-run-ovn\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.708667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.707795 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-run\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.708667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708246 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-node-log\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.708667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708290 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-node-log\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.708667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708308 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-cni-netd\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.708667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708332 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f1e99a4e-cb86-4060-a831-fb5113477814-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.708667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708350 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-system-cni-dir\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.709476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708397 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-multus-socket-dir-parent\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.709476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708445 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1e99a4e-cb86-4060-a831-fb5113477814-system-cni-dir\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.709476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708500 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jpkl6\" (UniqueName: \"kubernetes.io/projected/b3b653aa-519a-48d7-8d68-f907db391e06-kube-api-access-jpkl6\") pod \"network-metrics-daemon-dv4rg\" (UID: \"b3b653aa-519a-48d7-8d68-f907db391e06\") " pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:01:46.709476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708533 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-tuned\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.709476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708569 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13d85ccb-6812-49fd-a979-ca81ba04184d-ovn-node-metrics-cert\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.709476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708638 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-systemd-units\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.709476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708646 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-sysconfig\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.709476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708697 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-host-var-lib-kubelet\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.709476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708737 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-etc-kubernetes\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.709476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708772 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sj659\" (UniqueName: \"kubernetes.io/projected/b927495c-7a28-4a3d-aa2d-4517632b4814-kube-api-access-sj659\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.709476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708799 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2ae75b6b-e677-4ee1-99be-e5d2712e0482-device-dir\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.709476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708828 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f1e99a4e-cb86-4060-a831-fb5113477814-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.709476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708833 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/18564f1d-8be6-41ef-ac3b-7fe898a2d2b8-iptables-alerter-script\") pod \"iptables-alerter-7pmg9\" (UID: \"18564f1d-8be6-41ef-ac3b-7fe898a2d2b8\") " pod="openshift-network-operator/iptables-alerter-7pmg9" Jun 02 20:01:46.709476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708912 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-log-socket\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.709476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708959 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13d85ccb-6812-49fd-a979-ca81ba04184d-ovnkube-script-lib\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.709476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.708998 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b927495c-7a28-4a3d-aa2d-4517632b4814-cni-binary-copy\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.709476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.709031 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-multus-conf-dir\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.710387 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.709064 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1e99a4e-cb86-4060-a831-fb5113477814-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.710387 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.709098 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-var-lib-kubelet\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.710387 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.709132 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-run-systemd\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.710387 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.709167 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-etc-openvswitch\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.710387 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.709198 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-run-ovn-kubernetes\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.710387 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.709285 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-lib-modules\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.710387 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.709315 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a92766b7-de27-4a9c-8ec8-f55cbc5b26b8-serviceca\") pod \"node-ca-vszcp\" (UID: \"a92766b7-de27-4a9c-8ec8-f55cbc5b26b8\") " pod="openshift-image-registry/node-ca-vszcp" Jun 02 20:01:46.710387 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.709363 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2ae75b6b-e677-4ee1-99be-e5d2712e0482-registration-dir\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.710387 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.709389 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-host-var-lib-cni-bin\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.710387 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.709415 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-cni-netd\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.710387 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.709427 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-hostroot\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.710387 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.709482 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snq22\" (UniqueName: \"kubernetes.io/projected/3550fef2-7bdf-4f39-b59b-38be4c78fc52-kube-api-access-snq22\") pod \"node-resolver-wc9fq\" (UID: \"3550fef2-7bdf-4f39-b59b-38be4c78fc52\") " pod="openshift-dns/node-resolver-wc9fq" Jun 02 20:01:46.710387 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.709492 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-multus-socket-dir-parent\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.710387 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.709576 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-host-run-netns\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.710387 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.710105 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b927495c-7a28-4a3d-aa2d-4517632b4814-cni-binary-copy\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.710387 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.710268 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b927495c-7a28-4a3d-aa2d-4517632b4814-multus-daemon-config\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.710387 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.710332 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-host-run-multus-certs\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.710387 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.710391 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-host-var-lib-kubelet\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.711299 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.710447 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-etc-kubernetes\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.711299 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.710617 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13d85ccb-6812-49fd-a979-ca81ba04184d-ovnkube-script-lib\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.711299 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.710685 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-multus-conf-dir\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.711299 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.710760 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/089e630c-97ec-48b9-9300-ff9c367f88bf-var-lib-kubelet\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.711299 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.710767 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2ae75b6b-e677-4ee1-99be-e5d2712e0482-device-dir\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.711299 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.710822 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-run-systemd\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.711299 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.710873 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-etc-openvswitch\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.711299 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.710901 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1e99a4e-cb86-4060-a831-fb5113477814-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.711299 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.710917 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-host-run-ovn-kubernetes\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.711299 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.710968 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-host-var-lib-cni-bin\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.711299 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.711017 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-hostroot\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.711299 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.711175 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/089e630c-97ec-48b9-9300-ff9c367f88bf-etc-tuned\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.711900 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.711284 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1e99a4e-cb86-4060-a831-fb5113477814-system-cni-dir\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.711900 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.711503 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/18564f1d-8be6-41ef-ac3b-7fe898a2d2b8-iptables-alerter-script\") pod \"iptables-alerter-7pmg9\" (UID: \"18564f1d-8be6-41ef-ac3b-7fe898a2d2b8\") " pod="openshift-network-operator/iptables-alerter-7pmg9" Jun 02 20:01:46.711900 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:46.711651 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:01:46.711900 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.711746 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-log-socket\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.711900 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.711535 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2cfe96cc-8d38-4346-81ab-42172f429770-konnectivity-ca\") pod \"konnectivity-agent-pwg4k\" (UID: \"2cfe96cc-8d38-4346-81ab-42172f429770\") " pod="kube-system/konnectivity-agent-pwg4k" Jun 02 20:01:46.711900 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.711798 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13d85ccb-6812-49fd-a979-ca81ba04184d-run-ovn\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.711900 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:46.711890 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs podName:b3b653aa-519a-48d7-8d68-f907db391e06 nodeName:}" failed. No retries permitted until 2026-06-02 20:01:47.211836487 +0000 UTC m=+2.057122435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs") pod "network-metrics-daemon-dv4rg" (UID: "b3b653aa-519a-48d7-8d68-f907db391e06") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:01:46.712226 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.711991 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b927495c-7a28-4a3d-aa2d-4517632b4814-system-cni-dir\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.712729 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.712346 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13d85ccb-6812-49fd-a979-ca81ba04184d-ovn-node-metrics-cert\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.713260 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.713239 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3550fef2-7bdf-4f39-b59b-38be4c78fc52-tmp-dir\") pod \"node-resolver-wc9fq\" (UID: \"3550fef2-7bdf-4f39-b59b-38be4c78fc52\") " pod="openshift-dns/node-resolver-wc9fq" Jun 02 20:01:46.713649 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.713631 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2cfe96cc-8d38-4346-81ab-42172f429770-agent-certs\") pod \"konnectivity-agent-pwg4k\" (UID: \"2cfe96cc-8d38-4346-81ab-42172f429770\") " pod="kube-system/konnectivity-agent-pwg4k" Jun 02 20:01:46.719538 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.719362 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v46zz\" (UniqueName: \"kubernetes.io/projected/089e630c-97ec-48b9-9300-ff9c367f88bf-kube-api-access-v46zz\") pod \"tuned-bj5hn\" (UID: \"089e630c-97ec-48b9-9300-ff9c367f88bf\") " pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.720049 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:46.720016 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 20:01:46.720049 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:46.720043 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 20:01:46.720243 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:46.720057 2562 projected.go:194] Error preparing data for projected volume kube-api-access-pxxfb for pod openshift-network-diagnostics/network-check-target-fflxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:01:46.720243 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:46.720131 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb podName:3c8a3790-7924-4560-8de5-36ab2806c8a2 nodeName:}" failed. No retries permitted until 2026-06-02 20:01:47.220112848 +0000 UTC m=+2.065398815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pxxfb" (UniqueName: "kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb") pod "network-check-target-fflxg" (UID: "3c8a3790-7924-4560-8de5-36ab2806c8a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:01:46.721432 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.721412 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7brkd\" (UniqueName: \"kubernetes.io/projected/f1e99a4e-cb86-4060-a831-fb5113477814-kube-api-access-7brkd\") pod \"multus-additional-cni-plugins-vlr5w\" (UID: \"f1e99a4e-cb86-4060-a831-fb5113477814\") " pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.721675 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.721650 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk9ms\" (UniqueName: \"kubernetes.io/projected/2ae75b6b-e677-4ee1-99be-e5d2712e0482-kube-api-access-qk9ms\") pod \"aws-ebs-csi-driver-node-dw7pg\" (UID: \"2ae75b6b-e677-4ee1-99be-e5d2712e0482\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.722195 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.722166 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94bx2\" (UniqueName: \"kubernetes.io/projected/18564f1d-8be6-41ef-ac3b-7fe898a2d2b8-kube-api-access-94bx2\") pod \"iptables-alerter-7pmg9\" (UID: \"18564f1d-8be6-41ef-ac3b-7fe898a2d2b8\") " pod="openshift-network-operator/iptables-alerter-7pmg9" Jun 02 20:01:46.724149 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.723343 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rks7\" (UniqueName: \"kubernetes.io/projected/13d85ccb-6812-49fd-a979-ca81ba04184d-kube-api-access-5rks7\") pod \"ovnkube-node-qwd9g\" (UID: \"13d85ccb-6812-49fd-a979-ca81ba04184d\") " pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.724149 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.723771 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpkl6\" (UniqueName: \"kubernetes.io/projected/b3b653aa-519a-48d7-8d68-f907db391e06-kube-api-access-jpkl6\") pod \"network-metrics-daemon-dv4rg\" (UID: \"b3b653aa-519a-48d7-8d68-f907db391e06\") " pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:01:46.724703 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.724660 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94qkm\" (UniqueName: \"kubernetes.io/projected/a92766b7-de27-4a9c-8ec8-f55cbc5b26b8-kube-api-access-94qkm\") pod \"node-ca-vszcp\" (UID: \"a92766b7-de27-4a9c-8ec8-f55cbc5b26b8\") " pod="openshift-image-registry/node-ca-vszcp" Jun 02 20:01:46.725175 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.725153 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snq22\" (UniqueName: \"kubernetes.io/projected/3550fef2-7bdf-4f39-b59b-38be4c78fc52-kube-api-access-snq22\") pod \"node-resolver-wc9fq\" (UID: \"3550fef2-7bdf-4f39-b59b-38be4c78fc52\") " pod="openshift-dns/node-resolver-wc9fq" Jun 02 20:01:46.725569 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.725551 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj659\" (UniqueName: \"kubernetes.io/projected/b927495c-7a28-4a3d-aa2d-4517632b4814-kube-api-access-sj659\") pod \"multus-mfp9l\" (UID: \"b927495c-7a28-4a3d-aa2d-4517632b4814\") " pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.729648 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.729625 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 20:01:46.731323 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.731309 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" Jun 02 20:01:46.739292 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:46.739272 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod089e630c_97ec_48b9_9300_ff9c367f88bf.slice/crio-d856d9750b0c435defb3e5e421165b0f2fc42a49e922839396cf9f074e6ac649 WatchSource:0}: Error finding container d856d9750b0c435defb3e5e421165b0f2fc42a49e922839396cf9f074e6ac649: Status 404 returned error can't find the container with id d856d9750b0c435defb3e5e421165b0f2fc42a49e922839396cf9f074e6ac649 Jun 02 20:01:46.911242 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.911006 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:01:46.914699 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.914679 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wc9fq" Jun 02 20:01:46.918517 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:46.918487 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d85ccb_6812_49fd_a979_ca81ba04184d.slice/crio-55d89edb5d540f506b87146979348fbe4d09527d310fdacc91ff5456d80a68b9 WatchSource:0}: Error finding container 55d89edb5d540f506b87146979348fbe4d09527d310fdacc91ff5456d80a68b9: Status 404 returned error can't find the container with id 55d89edb5d540f506b87146979348fbe4d09527d310fdacc91ff5456d80a68b9 Jun 02 20:01:46.921273 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:46.921252 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3550fef2_7bdf_4f39_b59b_38be4c78fc52.slice/crio-f1c87011623265d313a7de73fba09a4692cd388ac476873bcf974091f2a486a1 WatchSource:0}: Error finding container f1c87011623265d313a7de73fba09a4692cd388ac476873bcf974091f2a486a1: Status 404 returned error can't find the container with id f1c87011623265d313a7de73fba09a4692cd388ac476873bcf974091f2a486a1 Jun 02 20:01:46.932784 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.932755 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vlr5w" Jun 02 20:01:46.939056 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:46.939035 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e99a4e_cb86_4060_a831_fb5113477814.slice/crio-74308784e670b7db011e1285f2e0ac9550eef8d91cd38b617e77944b1aaedaf4 WatchSource:0}: Error finding container 74308784e670b7db011e1285f2e0ac9550eef8d91cd38b617e77944b1aaedaf4: Status 404 returned error can't find the container with id 74308784e670b7db011e1285f2e0ac9550eef8d91cd38b617e77944b1aaedaf4 Jun 02 20:01:46.943881 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.943865 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mfp9l" Jun 02 20:01:46.949093 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:46.949073 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb927495c_7a28_4a3d_aa2d_4517632b4814.slice/crio-65a5bc7015aa05a1174455046e531032cfc257caf372ddea56f1b0311932b058 WatchSource:0}: Error finding container 65a5bc7015aa05a1174455046e531032cfc257caf372ddea56f1b0311932b058: Status 404 returned error can't find the container with id 65a5bc7015aa05a1174455046e531032cfc257caf372ddea56f1b0311932b058 Jun 02 20:01:46.960738 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.960717 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pwg4k" Jun 02 20:01:46.967171 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.967142 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" Jun 02 20:01:46.967263 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:46.967221 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cfe96cc_8d38_4346_81ab_42172f429770.slice/crio-d61eaa928918546cd39bd4c72b2a7c62438f2c68c0aaf47a6393428fa78909be WatchSource:0}: Error finding container d61eaa928918546cd39bd4c72b2a7c62438f2c68c0aaf47a6393428fa78909be: Status 404 returned error can't find the container with id d61eaa928918546cd39bd4c72b2a7c62438f2c68c0aaf47a6393428fa78909be Jun 02 20:01:46.972967 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:46.972943 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ae75b6b_e677_4ee1_99be_e5d2712e0482.slice/crio-bcf6763a08341d8ed7d774b681656d58743d2caa8ca261d5054baa8d0a622b32 WatchSource:0}: Error finding container bcf6763a08341d8ed7d774b681656d58743d2caa8ca261d5054baa8d0a622b32: Status 404 returned error can't find the container with id bcf6763a08341d8ed7d774b681656d58743d2caa8ca261d5054baa8d0a622b32 Jun 02 20:01:46.989926 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:46.989905 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7pmg9" Jun 02 20:01:46.996259 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:46.996232 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18564f1d_8be6_41ef_ac3b_7fe898a2d2b8.slice/crio-bc288ee4c28808d6b3f5106a729e53a6288a5e508eeb1eaf468f33027b49b059 WatchSource:0}: Error finding container bc288ee4c28808d6b3f5106a729e53a6288a5e508eeb1eaf468f33027b49b059: Status 404 returned error can't find the container with id bc288ee4c28808d6b3f5106a729e53a6288a5e508eeb1eaf468f33027b49b059 Jun 02 20:01:47.016711 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.016693 2562 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 20:01:47.019923 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.019900 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vszcp" Jun 02 20:01:47.026039 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:01:47.026016 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda92766b7_de27_4a9c_8ec8_f55cbc5b26b8.slice/crio-472a83fc9a42ccbeeca6c1c91377b4700d51b1a2f95893b9f18af7181722744c WatchSource:0}: Error finding container 472a83fc9a42ccbeeca6c1c91377b4700d51b1a2f95893b9f18af7181722744c: Status 404 returned error can't find the container with id 472a83fc9a42ccbeeca6c1c91377b4700d51b1a2f95893b9f18af7181722744c Jun 02 20:01:47.144178 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.144152 2562 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 20:01:47.213693 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.213612 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs\") pod \"network-metrics-daemon-dv4rg\" (UID: \"b3b653aa-519a-48d7-8d68-f907db391e06\") " pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:01:47.213845 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:47.213756 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:01:47.213845 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:47.213826 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs podName:b3b653aa-519a-48d7-8d68-f907db391e06 nodeName:}" failed. No retries permitted until 2026-06-02 20:01:48.213810595 +0000 UTC m=+3.059096541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs") pod "network-metrics-daemon-dv4rg" (UID: "b3b653aa-519a-48d7-8d68-f907db391e06") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:01:47.314735 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.314691 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxfb\" (UniqueName: \"kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb\") pod \"network-check-target-fflxg\" (UID: \"3c8a3790-7924-4560-8de5-36ab2806c8a2\") " pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:01:47.314919 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:47.314881 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 20:01:47.314919 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:47.314910 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 20:01:47.315031 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:47.314923 2562 projected.go:194] Error preparing data for projected volume kube-api-access-pxxfb for pod openshift-network-diagnostics/network-check-target-fflxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:01:47.315031 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:47.314988 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb podName:3c8a3790-7924-4560-8de5-36ab2806c8a2 nodeName:}" failed. No retries permitted until 2026-06-02 20:01:48.314968573 +0000 UTC m=+3.160254525 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pxxfb" (UniqueName: "kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb") pod "network-check-target-fflxg" (UID: "3c8a3790-7924-4560-8de5-36ab2806c8a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:01:47.648527 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.648391 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 19:56:46 +0000 UTC" deadline="2027-12-10 12:05:13.333199435 +0000 UTC" Jun 02 20:01:47.648527 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.648428 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13336h3m25.684774695s" Jun 02 20:01:47.723619 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.723487 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mfp9l" event={"ID":"b927495c-7a28-4a3d-aa2d-4517632b4814","Type":"ContainerStarted","Data":"65a5bc7015aa05a1174455046e531032cfc257caf372ddea56f1b0311932b058"} Jun 02 20:01:47.736697 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.736656 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlr5w" event={"ID":"f1e99a4e-cb86-4060-a831-fb5113477814","Type":"ContainerStarted","Data":"74308784e670b7db011e1285f2e0ac9550eef8d91cd38b617e77944b1aaedaf4"} Jun 02 20:01:47.761839 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.761801 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" event={"ID":"089e630c-97ec-48b9-9300-ff9c367f88bf","Type":"ContainerStarted","Data":"d856d9750b0c435defb3e5e421165b0f2fc42a49e922839396cf9f074e6ac649"} Jun 02 20:01:47.791209 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.791167 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal" event={"ID":"54102e30a1067a72b283ba73b26bd06e","Type":"ContainerStarted","Data":"0b05fc83c84732df3960b49d697ee30617a08014bde4971fea32a632f369abb6"} Jun 02 20:01:47.802220 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.802114 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vszcp" event={"ID":"a92766b7-de27-4a9c-8ec8-f55cbc5b26b8","Type":"ContainerStarted","Data":"472a83fc9a42ccbeeca6c1c91377b4700d51b1a2f95893b9f18af7181722744c"} Jun 02 20:01:47.833774 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.833701 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" event={"ID":"2ae75b6b-e677-4ee1-99be-e5d2712e0482","Type":"ContainerStarted","Data":"bcf6763a08341d8ed7d774b681656d58743d2caa8ca261d5054baa8d0a622b32"} Jun 02 20:01:47.856429 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.856251 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pwg4k" event={"ID":"2cfe96cc-8d38-4346-81ab-42172f429770","Type":"ContainerStarted","Data":"d61eaa928918546cd39bd4c72b2a7c62438f2c68c0aaf47a6393428fa78909be"} Jun 02 20:01:47.885621 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.885560 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wc9fq" event={"ID":"3550fef2-7bdf-4f39-b59b-38be4c78fc52","Type":"ContainerStarted","Data":"f1c87011623265d313a7de73fba09a4692cd388ac476873bcf974091f2a486a1"} Jun 02 20:01:47.902626 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.902543 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" event={"ID":"13d85ccb-6812-49fd-a979-ca81ba04184d","Type":"ContainerStarted","Data":"55d89edb5d540f506b87146979348fbe4d09527d310fdacc91ff5456d80a68b9"} Jun 02 20:01:47.916183 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.916134 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-46.ec2.internal" event={"ID":"d2c4fe31db52904cda32b7bc3da196d3","Type":"ContainerStarted","Data":"d25dc24e01143ca9b823293615585f0e80c68d1086811dfa93c8387e7b413c2e"} Jun 02 20:01:47.932253 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.932219 2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 20:01:47.949357 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:47.949299 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7pmg9" event={"ID":"18564f1d-8be6-41ef-ac3b-7fe898a2d2b8","Type":"ContainerStarted","Data":"bc288ee4c28808d6b3f5106a729e53a6288a5e508eeb1eaf468f33027b49b059"} Jun 02 20:01:48.223107 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:48.223016 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs\") pod \"network-metrics-daemon-dv4rg\" (UID: \"b3b653aa-519a-48d7-8d68-f907db391e06\") " pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:01:48.223281 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:48.223184 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:01:48.223281 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:48.223249 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs podName:b3b653aa-519a-48d7-8d68-f907db391e06 nodeName:}" failed. No retries permitted until 2026-06-02 20:01:50.223230085 +0000 UTC m=+5.068516056 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs") pod "network-metrics-daemon-dv4rg" (UID: "b3b653aa-519a-48d7-8d68-f907db391e06") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:01:48.324235 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:48.323612 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxfb\" (UniqueName: \"kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb\") pod \"network-check-target-fflxg\" (UID: \"3c8a3790-7924-4560-8de5-36ab2806c8a2\") " pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:01:48.324235 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:48.323781 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 20:01:48.324235 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:48.323800 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 20:01:48.324235 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:48.323812 2562 projected.go:194] Error preparing data for projected volume kube-api-access-pxxfb for pod openshift-network-diagnostics/network-check-target-fflxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:01:48.324235 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:48.323876 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb podName:3c8a3790-7924-4560-8de5-36ab2806c8a2 nodeName:}" failed. No retries permitted until 2026-06-02 20:01:50.323857268 +0000 UTC m=+5.169143214 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pxxfb" (UniqueName: "kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb") pod "network-check-target-fflxg" (UID: "3c8a3790-7924-4560-8de5-36ab2806c8a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:01:48.649046 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:48.648951 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 19:56:46 +0000 UTC" deadline="2027-11-17 10:28:39.004577571 +0000 UTC" Jun 02 20:01:48.649046 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:48.648998 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12782h26m50.355584184s" Jun 02 20:01:48.694851 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:48.694817 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:01:48.695001 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:48.694817 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:01:48.695001 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:48.694968 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:01:48.695091 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:48.695049 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflxg" podUID="3c8a3790-7924-4560-8de5-36ab2806c8a2" Jun 02 20:01:50.238423 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:50.238381 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs\") pod \"network-metrics-daemon-dv4rg\" (UID: \"b3b653aa-519a-48d7-8d68-f907db391e06\") " pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:01:50.238898 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:50.238581 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:01:50.238898 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:50.238654 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs podName:b3b653aa-519a-48d7-8d68-f907db391e06 nodeName:}" failed. No retries permitted until 2026-06-02 20:01:54.238635026 +0000 UTC m=+9.083920979 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs") pod "network-metrics-daemon-dv4rg" (UID: "b3b653aa-519a-48d7-8d68-f907db391e06") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:01:50.339421 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:50.339378 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxfb\" (UniqueName: \"kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb\") pod \"network-check-target-fflxg\" (UID: \"3c8a3790-7924-4560-8de5-36ab2806c8a2\") " pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:01:50.339631 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:50.339611 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 20:01:50.339693 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:50.339639 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 20:01:50.339693 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:50.339654 2562 projected.go:194] Error preparing data for projected volume kube-api-access-pxxfb for pod openshift-network-diagnostics/network-check-target-fflxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:01:50.339794 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:50.339713 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb podName:3c8a3790-7924-4560-8de5-36ab2806c8a2 nodeName:}" failed. No retries permitted until 2026-06-02 20:01:54.339694297 +0000 UTC m=+9.184980256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pxxfb" (UniqueName: "kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb") pod "network-check-target-fflxg" (UID: "3c8a3790-7924-4560-8de5-36ab2806c8a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:01:50.694159 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:50.694063 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:01:50.694323 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:50.694063 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:01:50.694323 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:50.694222 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:01:50.694323 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:50.694296 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflxg" podUID="3c8a3790-7924-4560-8de5-36ab2806c8a2" Jun 02 20:01:52.694695 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:52.694530 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:01:52.694695 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:52.694531 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:01:52.694695 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:52.694653 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflxg" podUID="3c8a3790-7924-4560-8de5-36ab2806c8a2" Jun 02 20:01:52.695257 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:52.694745 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:01:54.270519 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:54.270475 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs\") pod \"network-metrics-daemon-dv4rg\" (UID: \"b3b653aa-519a-48d7-8d68-f907db391e06\") " pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:01:54.270984 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:54.270590 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:01:54.270984 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:54.270673 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs podName:b3b653aa-519a-48d7-8d68-f907db391e06 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:02.270653054 +0000 UTC m=+17.115939004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs") pod "network-metrics-daemon-dv4rg" (UID: "b3b653aa-519a-48d7-8d68-f907db391e06") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:01:54.370855 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:54.370813 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxfb\" (UniqueName: \"kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb\") pod \"network-check-target-fflxg\" (UID: \"3c8a3790-7924-4560-8de5-36ab2806c8a2\") " pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:01:54.371039 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:54.371009 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 20:01:54.371039 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:54.371032 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 20:01:54.371146 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:54.371046 2562 projected.go:194] Error preparing data for projected volume kube-api-access-pxxfb for pod openshift-network-diagnostics/network-check-target-fflxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:01:54.371146 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:54.371094 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb podName:3c8a3790-7924-4560-8de5-36ab2806c8a2 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:02.371080937 +0000 UTC m=+17.216366883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pxxfb" (UniqueName: "kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb") pod "network-check-target-fflxg" (UID: "3c8a3790-7924-4560-8de5-36ab2806c8a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:01:54.695254 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:54.694621 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:01:54.695254 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:54.694761 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:01:54.695254 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:54.694829 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:01:54.695254 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:54.694894 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflxg" podUID="3c8a3790-7924-4560-8de5-36ab2806c8a2" Jun 02 20:01:56.694900 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:56.694686 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:01:56.694900 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:56.694704 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:01:56.694900 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:56.694852 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:01:56.694900 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:56.694853 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflxg" podUID="3c8a3790-7924-4560-8de5-36ab2806c8a2" Jun 02 20:01:58.694723 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:58.694630 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:01:58.694723 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:01:58.694665 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:01:58.695243 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:58.694761 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:01:58.695243 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:01:58.694817 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflxg" podUID="3c8a3790-7924-4560-8de5-36ab2806c8a2" Jun 02 20:02:00.693770 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:00.693728 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:02:00.694197 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:00.693728 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:02:00.694197 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:00.693886 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflxg" podUID="3c8a3790-7924-4560-8de5-36ab2806c8a2" Jun 02 20:02:00.694197 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:00.693994 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:02:02.333656 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:02.333608 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs\") pod \"network-metrics-daemon-dv4rg\" (UID: \"b3b653aa-519a-48d7-8d68-f907db391e06\") " pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:02:02.334033 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:02.333754 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:02:02.334033 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:02.333810 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs podName:b3b653aa-519a-48d7-8d68-f907db391e06 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:18.333794263 +0000 UTC m=+33.179080209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs") pod "network-metrics-daemon-dv4rg" (UID: "b3b653aa-519a-48d7-8d68-f907db391e06") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:02:02.437521 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:02.434646 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxfb\" (UniqueName: \"kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb\") pod \"network-check-target-fflxg\" (UID: \"3c8a3790-7924-4560-8de5-36ab2806c8a2\") " pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:02:02.437521 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:02.434873 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 20:02:02.437521 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:02.434901 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 20:02:02.437521 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:02.434914 2562 projected.go:194] Error preparing data for projected volume kube-api-access-pxxfb for pod openshift-network-diagnostics/network-check-target-fflxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:02:02.437521 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:02.434978 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb podName:3c8a3790-7924-4560-8de5-36ab2806c8a2 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:18.434953456 +0000 UTC m=+33.280239422 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pxxfb" (UniqueName: "kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb") pod "network-check-target-fflxg" (UID: "3c8a3790-7924-4560-8de5-36ab2806c8a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:02:02.694106 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:02.694014 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:02:02.694263 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:02.694130 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflxg" podUID="3c8a3790-7924-4560-8de5-36ab2806c8a2" Jun 02 20:02:02.694263 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:02.694190 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:02:02.694359 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:02.694298 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:02:04.693957 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:04.693923 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:02:04.694435 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:04.693923 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:02:04.694435 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:04.694046 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:02:04.694435 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:04.694106 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflxg" podUID="3c8a3790-7924-4560-8de5-36ab2806c8a2" Jun 02 20:02:04.700619 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:04.700594 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-dlshz"] Jun 02 20:02:04.750966 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:04.750930 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:04.751123 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:04.751021 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlshz" podUID="a1f2dc2a-48b4-4ba7-b8e1-75f572e70485" Jun 02 20:02:04.849793 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:04.849746 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret\") pod \"global-pull-secret-syncer-dlshz\" (UID: \"a1f2dc2a-48b4-4ba7-b8e1-75f572e70485\") " pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:04.849961 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:04.849828 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-kubelet-config\") pod \"global-pull-secret-syncer-dlshz\" (UID: \"a1f2dc2a-48b4-4ba7-b8e1-75f572e70485\") " pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:04.849961 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:04.849861 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-dbus\") pod \"global-pull-secret-syncer-dlshz\" (UID: \"a1f2dc2a-48b4-4ba7-b8e1-75f572e70485\") " pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:04.951212 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:04.951117 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-kubelet-config\") pod \"global-pull-secret-syncer-dlshz\" (UID: \"a1f2dc2a-48b4-4ba7-b8e1-75f572e70485\") " pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:04.951212 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:04.951176 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-dbus\") pod \"global-pull-secret-syncer-dlshz\" (UID: \"a1f2dc2a-48b4-4ba7-b8e1-75f572e70485\") " pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:04.951425 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:04.951236 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret\") pod \"global-pull-secret-syncer-dlshz\" (UID: \"a1f2dc2a-48b4-4ba7-b8e1-75f572e70485\") " pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:04.951425 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:04.951279 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-kubelet-config\") pod \"global-pull-secret-syncer-dlshz\" (UID: \"a1f2dc2a-48b4-4ba7-b8e1-75f572e70485\") " pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:04.951425 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:04.951296 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-dbus\") pod \"global-pull-secret-syncer-dlshz\" (UID: \"a1f2dc2a-48b4-4ba7-b8e1-75f572e70485\") " pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:04.951425 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:04.951334 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 20:02:04.951425 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:04.951390 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret podName:a1f2dc2a-48b4-4ba7-b8e1-75f572e70485 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:05.451373618 +0000 UTC m=+20.296659564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret") pod "global-pull-secret-syncer-dlshz" (UID: "a1f2dc2a-48b4-4ba7-b8e1-75f572e70485") : object "kube-system"/"original-pull-secret" not registered Jun 02 20:02:05.453556 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:05.453503 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret\") pod \"global-pull-secret-syncer-dlshz\" (UID: \"a1f2dc2a-48b4-4ba7-b8e1-75f572e70485\") " pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:05.453728 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:05.453645 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 20:02:05.453789 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:05.453729 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret podName:a1f2dc2a-48b4-4ba7-b8e1-75f572e70485 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:06.453708969 +0000 UTC m=+21.298994926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret") pod "global-pull-secret-syncer-dlshz" (UID: "a1f2dc2a-48b4-4ba7-b8e1-75f572e70485") : object "kube-system"/"original-pull-secret" not registered Jun 02 20:02:06.459626 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:06.459584 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret\") pod \"global-pull-secret-syncer-dlshz\" (UID: \"a1f2dc2a-48b4-4ba7-b8e1-75f572e70485\") " pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:06.460053 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:06.459696 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 20:02:06.460053 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:06.459746 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret podName:a1f2dc2a-48b4-4ba7-b8e1-75f572e70485 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:08.459733636 +0000 UTC m=+23.305019582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret") pod "global-pull-secret-syncer-dlshz" (UID: "a1f2dc2a-48b4-4ba7-b8e1-75f572e70485") : object "kube-system"/"original-pull-secret" not registered Jun 02 20:02:06.694645 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:06.694622 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:02:06.694747 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:06.694732 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:02:06.694789 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:06.694749 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:06.694842 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:06.694730 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflxg" podUID="3c8a3790-7924-4560-8de5-36ab2806c8a2" Jun 02 20:02:06.694878 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:06.694832 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:02:06.694912 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:06.694889 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlshz" podUID="a1f2dc2a-48b4-4ba7-b8e1-75f572e70485" Jun 02 20:02:06.987000 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:06.986741 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-46.ec2.internal" event={"ID":"d2c4fe31db52904cda32b7bc3da196d3","Type":"ContainerStarted","Data":"5911814504f97102274c439d08c2fa722fedd0252f75d8acfcd627ba6854e788"} Jun 02 20:02:06.988112 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:06.988084 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mfp9l" event={"ID":"b927495c-7a28-4a3d-aa2d-4517632b4814","Type":"ContainerStarted","Data":"fff8aa6d6fad629959fcde7764a6308ce9c5c5b0ad94edd7e74af4f92ec4c70a"} Jun 02 20:02:06.989280 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:06.989256 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" event={"ID":"089e630c-97ec-48b9-9300-ff9c367f88bf","Type":"ContainerStarted","Data":"ef3a461e67c87355ee2027b890ca1276d2970830201e8f274f7f573a6f88ec3d"} Jun 02 20:02:06.999661 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:06.999622 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-46.ec2.internal" podStartSLOduration=20.999610902 podStartE2EDuration="20.999610902s" podCreationTimestamp="2026-06-02 20:01:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:02:06.999395804 +0000 UTC m=+21.844681774" watchObservedRunningTime="2026-06-02 20:02:06.999610902 +0000 UTC m=+21.844896870" Jun 02 20:02:07.019277 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:07.019221 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-mfp9l" podStartSLOduration=2.261961546 podStartE2EDuration="22.0192057s" podCreationTimestamp="2026-06-02 20:01:45 +0000 UTC" firstStartedPulling="2026-06-02 20:01:46.950487361 +0000 UTC m=+1.795773320" lastFinishedPulling="2026-06-02 20:02:06.707731509 +0000 UTC m=+21.553017474" observedRunningTime="2026-06-02 20:02:07.018599627 +0000 UTC m=+21.863885595" watchObservedRunningTime="2026-06-02 20:02:07.0192057 +0000 UTC m=+21.864491669" Jun 02 20:02:07.033504 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:07.033450 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bj5hn" podStartSLOduration=1.23933205 podStartE2EDuration="21.03343893s" podCreationTimestamp="2026-06-02 20:01:46 +0000 UTC" firstStartedPulling="2026-06-02 20:01:46.740837731 +0000 UTC m=+1.586123676" lastFinishedPulling="2026-06-02 20:02:06.534944602 +0000 UTC m=+21.380230556" observedRunningTime="2026-06-02 20:02:07.032967698 +0000 UTC m=+21.878253665" watchObservedRunningTime="2026-06-02 20:02:07.03343893 +0000 UTC m=+21.878724909" Jun 02 20:02:07.992765 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:07.992581 2562 generic.go:358] "Generic (PLEG): container finished" podID="f1e99a4e-cb86-4060-a831-fb5113477814" containerID="3500df2ce25eff28826649248517314684b97c7f950c9b7ecdfd4f143e589eae" exitCode=0 Jun 02 20:02:07.993601 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:07.992659 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlr5w" event={"ID":"f1e99a4e-cb86-4060-a831-fb5113477814","Type":"ContainerDied","Data":"3500df2ce25eff28826649248517314684b97c7f950c9b7ecdfd4f143e589eae"} Jun 02 20:02:07.994490 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:07.994321 2562 generic.go:358] "Generic (PLEG): container finished" podID="54102e30a1067a72b283ba73b26bd06e" containerID="255ec7105873fb83ed758f617152a5e9d72bc396703095fb7aec159a77211d0d" exitCode=0 Jun 02 20:02:07.994490 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:07.994387 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal" event={"ID":"54102e30a1067a72b283ba73b26bd06e","Type":"ContainerDied","Data":"255ec7105873fb83ed758f617152a5e9d72bc396703095fb7aec159a77211d0d"} Jun 02 20:02:07.995845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:07.995808 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vszcp" event={"ID":"a92766b7-de27-4a9c-8ec8-f55cbc5b26b8","Type":"ContainerStarted","Data":"888ecf58e2093bba28e9923ef9ee4b26942b5a81a0be1862e744d6a396d34e55"} Jun 02 20:02:07.997020 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:07.996999 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" event={"ID":"2ae75b6b-e677-4ee1-99be-e5d2712e0482","Type":"ContainerStarted","Data":"795f532d076430b8f926760921dab7c0f62fee0ccf735120e4b085b97858dccb"} Jun 02 20:02:07.998210 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:07.998187 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pwg4k" event={"ID":"2cfe96cc-8d38-4346-81ab-42172f429770","Type":"ContainerStarted","Data":"e51ce0a703d8179949a72169bba202bab65d0a4d2bb6b68f161e1b92515701ac"} Jun 02 20:02:07.999474 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:07.999441 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wc9fq" event={"ID":"3550fef2-7bdf-4f39-b59b-38be4c78fc52","Type":"ContainerStarted","Data":"c5093d90ff577df93124dadce765d8f5ab4a9051c2f69725c4be7b0ec8143eb1"} Jun 02 20:02:08.002136 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:08.002113 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" event={"ID":"13d85ccb-6812-49fd-a979-ca81ba04184d","Type":"ContainerStarted","Data":"8e652efb10bef4bdb9638499bd9ba7fb02271e8be7419edd5d9dd4296cebaa4c"} Jun 02 20:02:08.002136 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:08.002139 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" event={"ID":"13d85ccb-6812-49fd-a979-ca81ba04184d","Type":"ContainerStarted","Data":"db6498f918998f4bf3eca8739cbcfa9885f2f52f7e535a1c0343213182a8ff20"} Jun 02 20:02:08.002297 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:08.002150 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" event={"ID":"13d85ccb-6812-49fd-a979-ca81ba04184d","Type":"ContainerStarted","Data":"4230d47f7a2945ef16572ede0b1792bd595a9003f3c5f75c073c414f4e09fadc"} Jun 02 20:02:08.002297 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:08.002158 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" event={"ID":"13d85ccb-6812-49fd-a979-ca81ba04184d","Type":"ContainerStarted","Data":"b63682075e7fe0eac595101ae7bb898b152e6e0f47a557811d07f74a7e680f45"} Jun 02 20:02:08.002297 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:08.002168 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" event={"ID":"13d85ccb-6812-49fd-a979-ca81ba04184d","Type":"ContainerStarted","Data":"d12b52f3aff82338f679ec0dc7dd4e0d0140c0de4a1ce57773b23b0bc250735b"} Jun 02 20:02:08.002297 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:08.002176 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" event={"ID":"13d85ccb-6812-49fd-a979-ca81ba04184d","Type":"ContainerStarted","Data":"4b1c6570e7aad161bc5ade602b760ecfe2ff690f4d605ac8b47993572f081f02"} Jun 02 20:02:08.069537 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:08.069454 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vszcp" podStartSLOduration=2.613534767 podStartE2EDuration="22.069435449s" podCreationTimestamp="2026-06-02 20:01:46 +0000 UTC" firstStartedPulling="2026-06-02 20:01:47.027535787 +0000 UTC m=+1.872821745" lastFinishedPulling="2026-06-02 20:02:06.483436473 +0000 UTC m=+21.328722427" observedRunningTime="2026-06-02 20:02:08.069140883 +0000 UTC m=+22.914426852" watchObservedRunningTime="2026-06-02 20:02:08.069435449 +0000 UTC m=+22.914721418" Jun 02 20:02:08.115559 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:08.115503 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pwg4k" podStartSLOduration=3.601920572 podStartE2EDuration="23.115484771s" podCreationTimestamp="2026-06-02 20:01:45 +0000 UTC" firstStartedPulling="2026-06-02 20:01:46.969871089 +0000 UTC m=+1.815157035" lastFinishedPulling="2026-06-02 20:02:06.483435273 +0000 UTC m=+21.328721234" observedRunningTime="2026-06-02 20:02:08.115441406 +0000 UTC m=+22.960727385" watchObservedRunningTime="2026-06-02 20:02:08.115484771 +0000 UTC m=+22.960770722" Jun 02 20:02:08.116012 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:08.115974 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-wc9fq" podStartSLOduration=3.5076869950000003 podStartE2EDuration="23.115965314s" podCreationTimestamp="2026-06-02 20:01:45 +0000 UTC" firstStartedPulling="2026-06-02 20:01:46.922768172 +0000 UTC m=+1.768054118" lastFinishedPulling="2026-06-02 20:02:06.531046477 +0000 UTC m=+21.376332437" observedRunningTime="2026-06-02 20:02:08.089419744 +0000 UTC m=+22.934705712" watchObservedRunningTime="2026-06-02 20:02:08.115965314 +0000 UTC m=+22.961251283" Jun 02 20:02:08.477498 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:08.477446 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret\") pod \"global-pull-secret-syncer-dlshz\" (UID: \"a1f2dc2a-48b4-4ba7-b8e1-75f572e70485\") " pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:08.477651 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:08.477580 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 20:02:08.477651 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:08.477649 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret podName:a1f2dc2a-48b4-4ba7-b8e1-75f572e70485 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:12.477625394 +0000 UTC m=+27.322911340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret") pod "global-pull-secret-syncer-dlshz" (UID: "a1f2dc2a-48b4-4ba7-b8e1-75f572e70485") : object "kube-system"/"original-pull-secret" not registered Jun 02 20:02:08.694026 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:08.694001 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:08.694158 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:08.694051 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:02:08.694158 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:08.694114 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflxg" podUID="3c8a3790-7924-4560-8de5-36ab2806c8a2" Jun 02 20:02:08.694158 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:08.694131 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:02:08.694313 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:08.694208 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:02:08.694313 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:08.694254 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlshz" podUID="a1f2dc2a-48b4-4ba7-b8e1-75f572e70485" Jun 02 20:02:08.800443 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:08.800416 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 20:02:09.006979 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:09.006875 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7pmg9" event={"ID":"18564f1d-8be6-41ef-ac3b-7fe898a2d2b8","Type":"ContainerStarted","Data":"480b38f39dd0363959619814dec19aef931967daeec89342590f5fd26ab8fb8d"} Jun 02 20:02:09.009911 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:09.009867 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" event={"ID":"2ae75b6b-e677-4ee1-99be-e5d2712e0482","Type":"ContainerStarted","Data":"a5893e85137c071f45b2cc35243c45bdd93ceab7afeb18770e5c97c1049bb81f"} Jun 02 20:02:09.031621 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:09.031568 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7pmg9" podStartSLOduration=3.498631789 podStartE2EDuration="23.031551895s" podCreationTimestamp="2026-06-02 20:01:46 +0000 UTC" firstStartedPulling="2026-06-02 20:01:46.998085486 +0000 UTC m=+1.843371431" lastFinishedPulling="2026-06-02 20:02:06.531005578 +0000 UTC m=+21.376291537" observedRunningTime="2026-06-02 20:02:09.030921517 +0000 UTC m=+23.876207511" watchObservedRunningTime="2026-06-02 20:02:09.031551895 +0000 UTC m=+23.876837866" Jun 02 20:02:09.669428 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:09.669332 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T20:02:08.800438279Z","UUID":"1878b3f7-a2f3-42a1-834a-1326cdd2e858","Handler":null,"Name":"","Endpoint":""} Jun 02 20:02:09.671051 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:09.671027 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 20:02:09.671051 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:09.671055 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 20:02:10.013911 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:10.013825 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal" event={"ID":"54102e30a1067a72b283ba73b26bd06e","Type":"ContainerStarted","Data":"af56c5e017c1f9102bbdadf1f1ecb9ee0b246ecf992222157e3dcbd250c9934a"} Jun 02 20:02:10.038305 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:10.038252 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-46.ec2.internal" podStartSLOduration=24.038230307 podStartE2EDuration="24.038230307s" podCreationTimestamp="2026-06-02 20:01:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:02:10.037806139 +0000 UTC m=+24.883092108" watchObservedRunningTime="2026-06-02 20:02:10.038230307 +0000 UTC m=+24.883516276" Jun 02 20:02:10.694877 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:10.694691 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:10.695090 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:10.694768 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:02:10.695090 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:10.694992 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlshz" podUID="a1f2dc2a-48b4-4ba7-b8e1-75f572e70485" Jun 02 20:02:10.695090 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:10.695061 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflxg" podUID="3c8a3790-7924-4560-8de5-36ab2806c8a2" Jun 02 20:02:10.695090 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:10.694796 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:02:10.695246 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:10.695175 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:02:11.018252 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:11.018165 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" event={"ID":"2ae75b6b-e677-4ee1-99be-e5d2712e0482","Type":"ContainerStarted","Data":"2c05303d4a038b565cf70ff5d9c5a47b6ef05c8672e15dff02b6cd3625bbf005"} Jun 02 20:02:11.021119 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:11.021094 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" event={"ID":"13d85ccb-6812-49fd-a979-ca81ba04184d","Type":"ContainerStarted","Data":"ce67f70e674a7c8496e79af32a55314d6aea0d15b3d955197beeb9800a1dbea8"} Jun 02 20:02:12.511978 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:12.511887 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret\") pod \"global-pull-secret-syncer-dlshz\" (UID: \"a1f2dc2a-48b4-4ba7-b8e1-75f572e70485\") " pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:12.512538 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:12.512053 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 20:02:12.512538 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:12.512136 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret podName:a1f2dc2a-48b4-4ba7-b8e1-75f572e70485 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:20.512115372 +0000 UTC m=+35.357401333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret") pod "global-pull-secret-syncer-dlshz" (UID: "a1f2dc2a-48b4-4ba7-b8e1-75f572e70485") : object "kube-system"/"original-pull-secret" not registered Jun 02 20:02:12.693221 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:12.693183 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pwg4k" Jun 02 20:02:12.693976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:12.693907 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:12.693976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:12.693938 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:02:12.694145 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:12.693990 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:02:12.694145 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:12.694060 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pwg4k" Jun 02 20:02:12.694249 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:12.694054 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlshz" podUID="a1f2dc2a-48b4-4ba7-b8e1-75f572e70485" Jun 02 20:02:12.694361 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:12.694312 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflxg" podUID="3c8a3790-7924-4560-8de5-36ab2806c8a2" Jun 02 20:02:12.694410 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:12.694392 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:02:12.711880 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:12.711830 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dw7pg" podStartSLOduration=4.649662356 podStartE2EDuration="27.711816432s" podCreationTimestamp="2026-06-02 20:01:45 +0000 UTC" firstStartedPulling="2026-06-02 20:01:46.974435279 +0000 UTC m=+1.819721239" lastFinishedPulling="2026-06-02 20:02:10.03658937 +0000 UTC m=+24.881875315" observedRunningTime="2026-06-02 20:02:11.049707549 +0000 UTC m=+25.894993518" watchObservedRunningTime="2026-06-02 20:02:12.711816432 +0000 UTC m=+27.557102399" Jun 02 20:02:13.027730 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:13.027693 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pwg4k" Jun 02 20:02:13.028049 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:13.028032 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pwg4k" Jun 02 20:02:14.032261 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:14.032019 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" event={"ID":"13d85ccb-6812-49fd-a979-ca81ba04184d","Type":"ContainerStarted","Data":"eb0a266052a71bc6a519d6587dc6028ca78be1779c23e1a971e16335e0d2e2da"} Jun 02 20:02:14.032968 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:14.032337 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:02:14.032968 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:14.032367 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:02:14.033848 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:14.033827 2562 generic.go:358] "Generic (PLEG): container finished" podID="f1e99a4e-cb86-4060-a831-fb5113477814" containerID="14b734091e8decac341495611a7da5ec4f9209c83c8f7c3473ff80c46de5c2d7" exitCode=0 Jun 02 20:02:14.033963 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:14.033918 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlr5w" event={"ID":"f1e99a4e-cb86-4060-a831-fb5113477814","Type":"ContainerDied","Data":"14b734091e8decac341495611a7da5ec4f9209c83c8f7c3473ff80c46de5c2d7"} Jun 02 20:02:14.048395 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:14.048343 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:02:14.065743 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:14.065701 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" podStartSLOduration=8.843139253 podStartE2EDuration="29.065689246s" podCreationTimestamp="2026-06-02 20:01:45 +0000 UTC" firstStartedPulling="2026-06-02 20:01:46.920104402 +0000 UTC m=+1.765390347" lastFinishedPulling="2026-06-02 20:02:07.142654379 +0000 UTC m=+21.987940340" observedRunningTime="2026-06-02 20:02:14.061939364 +0000 UTC m=+28.907225332" watchObservedRunningTime="2026-06-02 20:02:14.065689246 +0000 UTC m=+28.910975215" Jun 02 20:02:14.694810 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:14.694779 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:14.695053 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:14.694811 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:02:14.695053 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:14.694880 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlshz" podUID="a1f2dc2a-48b4-4ba7-b8e1-75f572e70485" Jun 02 20:02:14.695053 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:14.694926 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflxg" podUID="3c8a3790-7924-4560-8de5-36ab2806c8a2" Jun 02 20:02:14.695053 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:14.694966 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:02:14.695053 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:14.695027 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:02:15.036214 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:15.036130 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:02:15.052109 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:15.052085 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:02:15.534379 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:15.534343 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fflxg"] Jun 02 20:02:15.534606 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:15.534454 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:02:15.534606 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:15.534585 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflxg" podUID="3c8a3790-7924-4560-8de5-36ab2806c8a2" Jun 02 20:02:15.536711 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:15.536687 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dlshz"] Jun 02 20:02:15.536832 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:15.536765 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:15.536882 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:15.536841 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlshz" podUID="a1f2dc2a-48b4-4ba7-b8e1-75f572e70485" Jun 02 20:02:15.546789 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:15.546765 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dv4rg"] Jun 02 20:02:15.546920 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:15.546850 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:02:15.546982 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:15.546936 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:02:16.041298 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:16.041264 2562 generic.go:358] "Generic (PLEG): container finished" podID="f1e99a4e-cb86-4060-a831-fb5113477814" containerID="188e981dfaed0a5ac5b217c7c7d371d250cc5a517633345fa6cfa5db6ae9feed" exitCode=0 Jun 02 20:02:16.041701 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:16.041350 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlr5w" event={"ID":"f1e99a4e-cb86-4060-a831-fb5113477814","Type":"ContainerDied","Data":"188e981dfaed0a5ac5b217c7c7d371d250cc5a517633345fa6cfa5db6ae9feed"} Jun 02 20:02:17.694333 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:17.694151 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:02:17.694917 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:17.694151 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:17.694917 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:17.694429 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflxg" podUID="3c8a3790-7924-4560-8de5-36ab2806c8a2" Jun 02 20:02:17.694917 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:17.694197 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:02:17.694917 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:17.694505 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlshz" podUID="a1f2dc2a-48b4-4ba7-b8e1-75f572e70485" Jun 02 20:02:17.694917 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:17.694604 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:02:18.046740 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:18.046706 2562 generic.go:358] "Generic (PLEG): container finished" podID="f1e99a4e-cb86-4060-a831-fb5113477814" containerID="021b46b0d86938ac1c79ac2c79d620b7faff207188f20d50a38d2391906f2810" exitCode=0 Jun 02 20:02:18.046903 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:18.046791 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlr5w" event={"ID":"f1e99a4e-cb86-4060-a831-fb5113477814","Type":"ContainerDied","Data":"021b46b0d86938ac1c79ac2c79d620b7faff207188f20d50a38d2391906f2810"} Jun 02 20:02:18.352527 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:18.352489 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs\") pod \"network-metrics-daemon-dv4rg\" (UID: \"b3b653aa-519a-48d7-8d68-f907db391e06\") " pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:02:18.352702 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:18.352595 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:02:18.352702 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:18.352645 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs podName:b3b653aa-519a-48d7-8d68-f907db391e06 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:50.352631778 +0000 UTC m=+65.197917724 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs") pod "network-metrics-daemon-dv4rg" (UID: "b3b653aa-519a-48d7-8d68-f907db391e06") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:02:18.453663 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:18.453628 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxfb\" (UniqueName: \"kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb\") pod \"network-check-target-fflxg\" (UID: \"3c8a3790-7924-4560-8de5-36ab2806c8a2\") " pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:02:18.453816 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:18.453775 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 20:02:18.453816 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:18.453793 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 20:02:18.453816 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:18.453802 2562 projected.go:194] Error preparing data for projected volume kube-api-access-pxxfb for pod openshift-network-diagnostics/network-check-target-fflxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:02:18.453917 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:18.453850 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb podName:3c8a3790-7924-4560-8de5-36ab2806c8a2 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:50.453838186 +0000 UTC m=+65.299124136 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pxxfb" (UniqueName: "kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb") pod "network-check-target-fflxg" (UID: "3c8a3790-7924-4560-8de5-36ab2806c8a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:02:19.694164 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:19.694124 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:02:19.694164 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:19.694160 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:19.694751 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:19.694229 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fflxg" podUID="3c8a3790-7924-4560-8de5-36ab2806c8a2" Jun 02 20:02:19.694751 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:19.694272 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:02:19.694751 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:19.694392 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:02:19.694751 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:19.694499 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlshz" podUID="a1f2dc2a-48b4-4ba7-b8e1-75f572e70485" Jun 02 20:02:19.962778 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:19.962751 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-46.ec2.internal" event="NodeReady" Jun 02 20:02:19.962978 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:19.962911 2562 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 20:02:20.006409 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.006372 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-794f4fddd-wk9qz"] Jun 02 20:02:20.008028 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.008006 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5"] Jun 02 20:02:20.008250 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.008228 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.009943 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.009919 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:02:20.010054 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.009999 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms"] Jun 02 20:02:20.011654 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.011634 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx"] Jun 02 20:02:20.011797 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.011774 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" Jun 02 20:02:20.011922 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.011903 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 20:02:20.012513 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.012495 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 20:02:20.012783 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.012766 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 20:02:20.012864 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.012798 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 02 20:02:20.012864 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.012806 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 02 20:02:20.013246 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.013229 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw"] Jun 02 20:02:20.013382 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.013366 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx" Jun 02 20:02:20.013991 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.013967 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gj8r6\"" Jun 02 20:02:20.015161 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.015144 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.015260 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.015246 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hxgvv\"" Jun 02 20:02:20.015863 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.015839 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 20:02:20.015989 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.015871 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 02 20:02:20.015989 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.015917 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 20:02:20.016104 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.016002 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-rqfb8\"" Jun 02 20:02:20.016158 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.016145 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 02 20:02:20.016210 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.016168 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 20:02:20.019549 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.019515 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 02 20:02:20.019693 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.019679 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 02 20:02:20.019765 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.019748 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 02 20:02:20.022061 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.022044 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 02 20:02:20.028037 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.028009 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5"] Jun 02 20:02:20.032667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.032490 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-794f4fddd-wk9qz"] Jun 02 20:02:20.033109 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.033089 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 20:02:20.033322 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.033098 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4ggh2"] Jun 02 20:02:20.035417 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.035396 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx"] Jun 02 20:02:20.035501 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.035422 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms"] Jun 02 20:02:20.035501 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.035438 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zvshg"] Jun 02 20:02:20.035572 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.035547 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4ggh2" Jun 02 20:02:20.038008 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.037989 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw"] Jun 02 20:02:20.038104 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.038089 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:02:20.039695 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.039676 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 20:02:20.039778 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.039705 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 20:02:20.042872 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.042853 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 20:02:20.042955 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.042924 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hqb8x\"" Jun 02 20:02:20.043244 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.043226 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 20:02:20.043321 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.043290 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 20:02:20.043420 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.043387 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gclhs\"" Jun 02 20:02:20.049484 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.049055 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zvshg"] Jun 02 20:02:20.054510 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.054487 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4ggh2"] Jun 02 20:02:20.165501 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165447 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f666aa31-46ef-4136-8a69-425ae56881a3-registry-certificates\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.165501 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165501 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f666aa31-46ef-4136-8a69-425ae56881a3-ca-trust-extracted\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.165734 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165521 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e80e5c0-6038-4be8-9f83-abc280066c95-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx\" (UID: \"3e80e5c0-6038-4be8-9f83-abc280066c95\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx" Jun 02 20:02:20.165734 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165539 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-config-volume\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:02:20.165734 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165558 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-bound-sa-token\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.165734 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165573 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c06a0fe8-3f02-4a19-8f45-0993755dab12-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw\" (UID: \"c06a0fe8-3f02-4a19-8f45-0993755dab12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.165734 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b42cdcb3-9795-438c-9a98-8b3e4542f023-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-btpl5\" (UID: \"b42cdcb3-9795-438c-9a98-8b3e4542f023\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:02:20.165734 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165652 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f666aa31-46ef-4136-8a69-425ae56881a3-image-registry-private-configuration\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.165734 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165672 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:02:20.165734 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165713 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.165734 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psmll\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-kube-api-access-psmll\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.166030 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165757 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f666aa31-46ef-4136-8a69-425ae56881a3-trusted-ca\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.166030 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165776 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee-klusterlet-config\") pod \"klusterlet-addon-workmgr-7649755c47-lq9ms\" (UID: \"7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" Jun 02 20:02:20.166030 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165792 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c06a0fe8-3f02-4a19-8f45-0993755dab12-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw\" (UID: \"c06a0fe8-3f02-4a19-8f45-0993755dab12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.166030 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165810 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-tmp-dir\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:02:20.166030 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165842 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f666aa31-46ef-4136-8a69-425ae56881a3-installation-pull-secrets\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.166030 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165870 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert\") pod \"ingress-canary-zvshg\" (UID: \"7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab\") " pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:02:20.166030 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzfpx\" (UniqueName: \"kubernetes.io/projected/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-kube-api-access-nzfpx\") pod \"ingress-canary-zvshg\" (UID: \"7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab\") " pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:02:20.166030 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165932 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q6hx\" (UniqueName: \"kubernetes.io/projected/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-kube-api-access-5q6hx\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:02:20.166030 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd7kp\" (UniqueName: \"kubernetes.io/projected/7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee-kube-api-access-dd7kp\") pod \"klusterlet-addon-workmgr-7649755c47-lq9ms\" (UID: \"7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" Jun 02 20:02:20.166030 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.165995 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjq8d\" (UniqueName: \"kubernetes.io/projected/c06a0fe8-3f02-4a19-8f45-0993755dab12-kube-api-access-tjq8d\") pod \"cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw\" (UID: \"c06a0fe8-3f02-4a19-8f45-0993755dab12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.166030 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.166014 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/c06a0fe8-3f02-4a19-8f45-0993755dab12-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw\" (UID: \"c06a0fe8-3f02-4a19-8f45-0993755dab12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.166405 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.166060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c06a0fe8-3f02-4a19-8f45-0993755dab12-hub\") pod \"cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw\" (UID: \"c06a0fe8-3f02-4a19-8f45-0993755dab12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.166405 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.166107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-btpl5\" (UID: \"b42cdcb3-9795-438c-9a98-8b3e4542f023\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:02:20.166405 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.166135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wld79\" (UniqueName: \"kubernetes.io/projected/3e80e5c0-6038-4be8-9f83-abc280066c95-kube-api-access-wld79\") pod \"managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx\" (UID: \"3e80e5c0-6038-4be8-9f83-abc280066c95\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx" Jun 02 20:02:20.166405 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.166159 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c06a0fe8-3f02-4a19-8f45-0993755dab12-ca\") pod \"cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw\" (UID: \"c06a0fe8-3f02-4a19-8f45-0993755dab12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.166405 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.166181 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee-tmp\") pod \"klusterlet-addon-workmgr-7649755c47-lq9ms\" (UID: \"7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" Jun 02 20:02:20.267099 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.266999 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tjq8d\" (UniqueName: \"kubernetes.io/projected/c06a0fe8-3f02-4a19-8f45-0993755dab12-kube-api-access-tjq8d\") pod \"cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw\" (UID: \"c06a0fe8-3f02-4a19-8f45-0993755dab12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.267099 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267051 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/c06a0fe8-3f02-4a19-8f45-0993755dab12-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw\" (UID: \"c06a0fe8-3f02-4a19-8f45-0993755dab12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.267099 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267098 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c06a0fe8-3f02-4a19-8f45-0993755dab12-hub\") pod \"cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw\" (UID: \"c06a0fe8-3f02-4a19-8f45-0993755dab12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.267381 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267129 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-btpl5\" (UID: \"b42cdcb3-9795-438c-9a98-8b3e4542f023\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:02:20.267381 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267158 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wld79\" (UniqueName: \"kubernetes.io/projected/3e80e5c0-6038-4be8-9f83-abc280066c95-kube-api-access-wld79\") pod \"managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx\" (UID: \"3e80e5c0-6038-4be8-9f83-abc280066c95\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx" Jun 02 20:02:20.267381 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267183 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c06a0fe8-3f02-4a19-8f45-0993755dab12-ca\") pod \"cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw\" (UID: \"c06a0fe8-3f02-4a19-8f45-0993755dab12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.267381 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267209 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee-tmp\") pod \"klusterlet-addon-workmgr-7649755c47-lq9ms\" (UID: \"7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" Jun 02 20:02:20.267381 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.267268 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 20:02:20.267381 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.267349 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert podName:b42cdcb3-9795-438c-9a98-8b3e4542f023 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:20.76732845 +0000 UTC m=+35.612614396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-btpl5" (UID: "b42cdcb3-9795-438c-9a98-8b3e4542f023") : secret "networking-console-plugin-cert" not found Jun 02 20:02:20.267717 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267383 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f666aa31-46ef-4136-8a69-425ae56881a3-registry-certificates\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.267717 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267426 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f666aa31-46ef-4136-8a69-425ae56881a3-ca-trust-extracted\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.267717 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267455 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e80e5c0-6038-4be8-9f83-abc280066c95-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx\" (UID: \"3e80e5c0-6038-4be8-9f83-abc280066c95\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx" Jun 02 20:02:20.267717 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267508 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-config-volume\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:02:20.267717 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267539 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-bound-sa-token\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.267717 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267609 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee-tmp\") pod \"klusterlet-addon-workmgr-7649755c47-lq9ms\" (UID: \"7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" Jun 02 20:02:20.267717 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267615 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c06a0fe8-3f02-4a19-8f45-0993755dab12-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw\" (UID: \"c06a0fe8-3f02-4a19-8f45-0993755dab12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.267717 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267674 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b42cdcb3-9795-438c-9a98-8b3e4542f023-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-btpl5\" (UID: \"b42cdcb3-9795-438c-9a98-8b3e4542f023\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:02:20.267717 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267708 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f666aa31-46ef-4136-8a69-425ae56881a3-image-registry-private-configuration\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.268079 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267736 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:02:20.268079 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267777 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.268079 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267803 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-psmll\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-kube-api-access-psmll\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.268079 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267840 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f666aa31-46ef-4136-8a69-425ae56881a3-trusted-ca\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.268079 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267866 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee-klusterlet-config\") pod \"klusterlet-addon-workmgr-7649755c47-lq9ms\" (UID: \"7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" Jun 02 20:02:20.268079 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267896 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c06a0fe8-3f02-4a19-8f45-0993755dab12-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw\" (UID: \"c06a0fe8-3f02-4a19-8f45-0993755dab12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.268079 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267924 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-tmp-dir\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:02:20.268079 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267949 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/c06a0fe8-3f02-4a19-8f45-0993755dab12-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw\" (UID: \"c06a0fe8-3f02-4a19-8f45-0993755dab12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.268079 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.267954 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f666aa31-46ef-4136-8a69-425ae56881a3-installation-pull-secrets\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.268079 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.268063 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f666aa31-46ef-4136-8a69-425ae56881a3-registry-certificates\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.268079 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.268076 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert\") pod \"ingress-canary-zvshg\" (UID: \"7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab\") " pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:02:20.268552 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.268177 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzfpx\" (UniqueName: \"kubernetes.io/projected/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-kube-api-access-nzfpx\") pod \"ingress-canary-zvshg\" (UID: \"7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab\") " pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:02:20.268552 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.268209 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5q6hx\" (UniqueName: \"kubernetes.io/projected/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-kube-api-access-5q6hx\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:02:20.268552 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.268241 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dd7kp\" (UniqueName: \"kubernetes.io/projected/7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee-kube-api-access-dd7kp\") pod \"klusterlet-addon-workmgr-7649755c47-lq9ms\" (UID: \"7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" Jun 02 20:02:20.268552 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.268449 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 20:02:20.268552 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.268514 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert podName:7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab nodeName:}" failed. No retries permitted until 2026-06-02 20:02:20.768499098 +0000 UTC m=+35.613785059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert") pod "ingress-canary-zvshg" (UID: "7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab") : secret "canary-serving-cert" not found Jun 02 20:02:20.268753 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.268621 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b42cdcb3-9795-438c-9a98-8b3e4542f023-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-btpl5\" (UID: \"b42cdcb3-9795-438c-9a98-8b3e4542f023\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:02:20.268753 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.268687 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-config-volume\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:02:20.268834 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.268825 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 20:02:20.268875 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.268863 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls podName:dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:20.768849637 +0000 UTC m=+35.614135583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls") pod "dns-default-4ggh2" (UID: "dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5") : secret "dns-default-metrics-tls" not found Jun 02 20:02:20.268923 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.268917 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 20:02:20.268960 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.268927 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794f4fddd-wk9qz: secret "image-registry-tls" not found Jun 02 20:02:20.268960 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.268953 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls podName:f666aa31-46ef-4136-8a69-425ae56881a3 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:20.768944547 +0000 UTC m=+35.614230493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls") pod "image-registry-794f4fddd-wk9qz" (UID: "f666aa31-46ef-4136-8a69-425ae56881a3") : secret "image-registry-tls" not found Jun 02 20:02:20.269244 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.269143 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f666aa31-46ef-4136-8a69-425ae56881a3-ca-trust-extracted\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.269504 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.269483 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-tmp-dir\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:02:20.270172 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.270139 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f666aa31-46ef-4136-8a69-425ae56881a3-trusted-ca\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.272956 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.272925 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c06a0fe8-3f02-4a19-8f45-0993755dab12-ca\") pod \"cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw\" (UID: \"c06a0fe8-3f02-4a19-8f45-0993755dab12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.273063 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.273047 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c06a0fe8-3f02-4a19-8f45-0993755dab12-hub\") pod \"cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw\" (UID: \"c06a0fe8-3f02-4a19-8f45-0993755dab12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.273120 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.273104 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e80e5c0-6038-4be8-9f83-abc280066c95-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx\" (UID: \"3e80e5c0-6038-4be8-9f83-abc280066c95\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx" Jun 02 20:02:20.273454 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.273429 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f666aa31-46ef-4136-8a69-425ae56881a3-installation-pull-secrets\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.273934 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.273899 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f666aa31-46ef-4136-8a69-425ae56881a3-image-registry-private-configuration\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.274769 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.274385 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee-klusterlet-config\") pod \"klusterlet-addon-workmgr-7649755c47-lq9ms\" (UID: \"7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" Jun 02 20:02:20.275184 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.275158 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c06a0fe8-3f02-4a19-8f45-0993755dab12-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw\" (UID: \"c06a0fe8-3f02-4a19-8f45-0993755dab12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.275271 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.275257 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c06a0fe8-3f02-4a19-8f45-0993755dab12-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw\" (UID: \"c06a0fe8-3f02-4a19-8f45-0993755dab12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.277768 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.277740 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wld79\" (UniqueName: \"kubernetes.io/projected/3e80e5c0-6038-4be8-9f83-abc280066c95-kube-api-access-wld79\") pod \"managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx\" (UID: \"3e80e5c0-6038-4be8-9f83-abc280066c95\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx" Jun 02 20:02:20.278362 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.278318 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjq8d\" (UniqueName: \"kubernetes.io/projected/c06a0fe8-3f02-4a19-8f45-0993755dab12-kube-api-access-tjq8d\") pod \"cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw\" (UID: \"c06a0fe8-3f02-4a19-8f45-0993755dab12\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.278690 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.278672 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd7kp\" (UniqueName: \"kubernetes.io/projected/7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee-kube-api-access-dd7kp\") pod \"klusterlet-addon-workmgr-7649755c47-lq9ms\" (UID: \"7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" Jun 02 20:02:20.279485 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.279294 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q6hx\" (UniqueName: \"kubernetes.io/projected/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-kube-api-access-5q6hx\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:02:20.279613 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.279597 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-bound-sa-token\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.280174 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.280155 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psmll\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-kube-api-access-psmll\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.281098 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.281078 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzfpx\" (UniqueName: \"kubernetes.io/projected/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-kube-api-access-nzfpx\") pod \"ingress-canary-zvshg\" (UID: \"7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab\") " pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:02:20.344652 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.344614 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" Jun 02 20:02:20.359581 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.359554 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx" Jun 02 20:02:20.365747 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.365720 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:02:20.531369 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.530409 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms"] Jun 02 20:02:20.532097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.532066 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw"] Jun 02 20:02:20.534873 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:02:20.534846 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ea27dbe_4e2f_4aa2_beaa_72542d4d1cee.slice/crio-da41955e61191fbe7fe2c7ae1af055418ae1559f90020816788afe1da3231ce6 WatchSource:0}: Error finding container da41955e61191fbe7fe2c7ae1af055418ae1559f90020816788afe1da3231ce6: Status 404 returned error can't find the container with id da41955e61191fbe7fe2c7ae1af055418ae1559f90020816788afe1da3231ce6 Jun 02 20:02:20.535771 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:02:20.535679 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc06a0fe8_3f02_4a19_8f45_0993755dab12.slice/crio-4c8ef4049b7c33c65bca2bd86a0ccbfe42415f27a9664a8a76cacbcd80e78cf2 WatchSource:0}: Error finding container 4c8ef4049b7c33c65bca2bd86a0ccbfe42415f27a9664a8a76cacbcd80e78cf2: Status 404 returned error can't find the container with id 4c8ef4049b7c33c65bca2bd86a0ccbfe42415f27a9664a8a76cacbcd80e78cf2 Jun 02 20:02:20.539129 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.537836 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx"] Jun 02 20:02:20.541402 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:02:20.541371 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e80e5c0_6038_4be8_9f83_abc280066c95.slice/crio-d6dd331d75d05afb8571d0d50b5f012ce9800515246e203063095208d7f6ec45 WatchSource:0}: Error finding container d6dd331d75d05afb8571d0d50b5f012ce9800515246e203063095208d7f6ec45: Status 404 returned error can't find the container with id d6dd331d75d05afb8571d0d50b5f012ce9800515246e203063095208d7f6ec45 Jun 02 20:02:20.570729 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.570693 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret\") pod \"global-pull-secret-syncer-dlshz\" (UID: \"a1f2dc2a-48b4-4ba7-b8e1-75f572e70485\") " pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:20.570873 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.570816 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 20:02:20.570937 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.570893 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret podName:a1f2dc2a-48b4-4ba7-b8e1-75f572e70485 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:36.570869893 +0000 UTC m=+51.416155855 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret") pod "global-pull-secret-syncer-dlshz" (UID: "a1f2dc2a-48b4-4ba7-b8e1-75f572e70485") : object "kube-system"/"original-pull-secret" not registered Jun 02 20:02:20.772113 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.772067 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert\") pod \"ingress-canary-zvshg\" (UID: \"7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab\") " pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:02:20.772672 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.772194 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-btpl5\" (UID: \"b42cdcb3-9795-438c-9a98-8b3e4542f023\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:02:20.772672 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.772238 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:02:20.772672 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:20.772267 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:20.772672 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.772272 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 20:02:20.772672 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.772353 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert podName:7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab nodeName:}" failed. No retries permitted until 2026-06-02 20:02:21.77232958 +0000 UTC m=+36.617615532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert") pod "ingress-canary-zvshg" (UID: "7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab") : secret "canary-serving-cert" not found Jun 02 20:02:20.772672 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.772361 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 20:02:20.772672 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.772368 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 20:02:20.772672 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.772372 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 20:02:20.772672 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.772425 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert podName:b42cdcb3-9795-438c-9a98-8b3e4542f023 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:21.772409601 +0000 UTC m=+36.617695559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-btpl5" (UID: "b42cdcb3-9795-438c-9a98-8b3e4542f023") : secret "networking-console-plugin-cert" not found Jun 02 20:02:20.772672 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.772429 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794f4fddd-wk9qz: secret "image-registry-tls" not found Jun 02 20:02:20.772672 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.772442 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls podName:dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:21.772434211 +0000 UTC m=+36.617720163 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls") pod "dns-default-4ggh2" (UID: "dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5") : secret "dns-default-metrics-tls" not found Jun 02 20:02:20.772672 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:20.772490 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls podName:f666aa31-46ef-4136-8a69-425ae56881a3 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:21.772474337 +0000 UTC m=+36.617760287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls") pod "image-registry-794f4fddd-wk9qz" (UID: "f666aa31-46ef-4136-8a69-425ae56881a3") : secret "image-registry-tls" not found Jun 02 20:02:21.053317 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:21.053282 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx" event={"ID":"3e80e5c0-6038-4be8-9f83-abc280066c95","Type":"ContainerStarted","Data":"d6dd331d75d05afb8571d0d50b5f012ce9800515246e203063095208d7f6ec45"} Jun 02 20:02:21.054274 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:21.054250 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" event={"ID":"7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee","Type":"ContainerStarted","Data":"da41955e61191fbe7fe2c7ae1af055418ae1559f90020816788afe1da3231ce6"} Jun 02 20:02:21.055113 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:21.055094 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" event={"ID":"c06a0fe8-3f02-4a19-8f45-0993755dab12","Type":"ContainerStarted","Data":"4c8ef4049b7c33c65bca2bd86a0ccbfe42415f27a9664a8a76cacbcd80e78cf2"} Jun 02 20:02:21.694842 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:21.694805 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:02:21.695869 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:21.695848 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:21.696821 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:21.696799 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:02:21.700505 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:21.700288 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 20:02:21.701314 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:21.701290 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 20:02:21.701565 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:21.701538 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vzgsf\"" Jun 02 20:02:21.702056 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:21.701727 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 20:02:21.702056 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:21.701947 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 20:02:21.702199 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:21.702132 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s8fv6\"" Jun 02 20:02:21.783569 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:21.783530 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:21.784026 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:21.783605 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert\") pod \"ingress-canary-zvshg\" (UID: \"7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab\") " pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:02:21.784026 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:21.783693 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-btpl5\" (UID: \"b42cdcb3-9795-438c-9a98-8b3e4542f023\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:02:21.784026 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:21.783751 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:02:21.784026 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:21.783899 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 20:02:21.784026 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:21.783961 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls podName:dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:23.783942447 +0000 UTC m=+38.629228410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls") pod "dns-default-4ggh2" (UID: "dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5") : secret "dns-default-metrics-tls" not found Jun 02 20:02:21.784392 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:21.784366 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 20:02:21.784392 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:21.784386 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794f4fddd-wk9qz: secret "image-registry-tls" not found Jun 02 20:02:21.784538 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:21.784434 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls podName:f666aa31-46ef-4136-8a69-425ae56881a3 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:23.784417801 +0000 UTC m=+38.629703763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls") pod "image-registry-794f4fddd-wk9qz" (UID: "f666aa31-46ef-4136-8a69-425ae56881a3") : secret "image-registry-tls" not found Jun 02 20:02:21.784538 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:21.784517 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 20:02:21.784644 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:21.784552 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert podName:7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab nodeName:}" failed. No retries permitted until 2026-06-02 20:02:23.78454164 +0000 UTC m=+38.629827603 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert") pod "ingress-canary-zvshg" (UID: "7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab") : secret "canary-serving-cert" not found Jun 02 20:02:21.784644 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:21.784608 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 20:02:21.784644 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:21.784642 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert podName:b42cdcb3-9795-438c-9a98-8b3e4542f023 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:23.784630951 +0000 UTC m=+38.629916910 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-btpl5" (UID: "b42cdcb3-9795-438c-9a98-8b3e4542f023") : secret "networking-console-plugin-cert" not found Jun 02 20:02:23.803907 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:23.803863 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-btpl5\" (UID: \"b42cdcb3-9795-438c-9a98-8b3e4542f023\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:02:23.804372 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:23.803936 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:02:23.804372 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:23.803980 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:23.804372 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:23.804014 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert\") pod \"ingress-canary-zvshg\" (UID: \"7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab\") " pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:02:23.804372 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:23.804042 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 20:02:23.804372 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:23.804094 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 20:02:23.804372 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:23.804103 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 20:02:23.804372 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:23.804121 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert podName:b42cdcb3-9795-438c-9a98-8b3e4542f023 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:27.804100585 +0000 UTC m=+42.649386531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-btpl5" (UID: "b42cdcb3-9795-438c-9a98-8b3e4542f023") : secret "networking-console-plugin-cert" not found Jun 02 20:02:23.804372 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:23.804140 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert podName:7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab nodeName:}" failed. No retries permitted until 2026-06-02 20:02:27.804131073 +0000 UTC m=+42.649417019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert") pod "ingress-canary-zvshg" (UID: "7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab") : secret "canary-serving-cert" not found Jun 02 20:02:23.804372 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:23.804156 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls podName:dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:27.804147566 +0000 UTC m=+42.649433514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls") pod "dns-default-4ggh2" (UID: "dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5") : secret "dns-default-metrics-tls" not found Jun 02 20:02:23.804372 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:23.804169 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 20:02:23.804372 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:23.804179 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794f4fddd-wk9qz: secret "image-registry-tls" not found Jun 02 20:02:23.804372 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:23.804204 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls podName:f666aa31-46ef-4136-8a69-425ae56881a3 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:27.804193863 +0000 UTC m=+42.649479812 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls") pod "image-registry-794f4fddd-wk9qz" (UID: "f666aa31-46ef-4136-8a69-425ae56881a3") : secret "image-registry-tls" not found Jun 02 20:02:27.838169 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:27.838113 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert\") pod \"ingress-canary-zvshg\" (UID: \"7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab\") " pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:02:27.838618 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:27.838240 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-btpl5\" (UID: \"b42cdcb3-9795-438c-9a98-8b3e4542f023\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:02:27.838618 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:27.838291 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 20:02:27.838618 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:27.838369 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert podName:7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab nodeName:}" failed. No retries permitted until 2026-06-02 20:02:35.838347523 +0000 UTC m=+50.683633486 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert") pod "ingress-canary-zvshg" (UID: "7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab") : secret "canary-serving-cert" not found Jun 02 20:02:27.838618 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:27.838371 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 20:02:27.838618 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:27.838383 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 20:02:27.838618 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:27.838410 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert podName:b42cdcb3-9795-438c-9a98-8b3e4542f023 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:35.838399707 +0000 UTC m=+50.683685659 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-btpl5" (UID: "b42cdcb3-9795-438c-9a98-8b3e4542f023") : secret "networking-console-plugin-cert" not found Jun 02 20:02:27.838618 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:27.838295 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:02:27.838618 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:27.838434 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls podName:dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:35.838417843 +0000 UTC m=+50.683703801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls") pod "dns-default-4ggh2" (UID: "dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5") : secret "dns-default-metrics-tls" not found Jun 02 20:02:27.838618 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:27.838509 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:27.838618 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:27.838609 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 20:02:27.838618 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:27.838620 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794f4fddd-wk9qz: secret "image-registry-tls" not found Jun 02 20:02:27.839064 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:27.838655 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls podName:f666aa31-46ef-4136-8a69-425ae56881a3 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:35.838644152 +0000 UTC m=+50.683930113 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls") pod "image-registry-794f4fddd-wk9qz" (UID: "f666aa31-46ef-4136-8a69-425ae56881a3") : secret "image-registry-tls" not found Jun 02 20:02:31.077302 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:31.077266 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" event={"ID":"c06a0fe8-3f02-4a19-8f45-0993755dab12","Type":"ContainerStarted","Data":"c905648f2693721b92cc69ab274c03cc0c665fce54811d9accef40bc3102d13c"} Jun 02 20:02:31.078549 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:31.078526 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx" event={"ID":"3e80e5c0-6038-4be8-9f83-abc280066c95","Type":"ContainerStarted","Data":"9f357685a526b9561cc02f2592c249ff8f1fdb0650e0aed7b01ebe502e61ded2"} Jun 02 20:02:31.080857 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:31.080836 2562 generic.go:358] "Generic (PLEG): container finished" podID="f1e99a4e-cb86-4060-a831-fb5113477814" containerID="7cbb124179f388158857792f237c9103daff3b67c6e1735e190dafd8d2d3c502" exitCode=0 Jun 02 20:02:31.080947 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:31.080916 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlr5w" event={"ID":"f1e99a4e-cb86-4060-a831-fb5113477814","Type":"ContainerDied","Data":"7cbb124179f388158857792f237c9103daff3b67c6e1735e190dafd8d2d3c502"} Jun 02 20:02:31.082246 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:31.082224 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" event={"ID":"7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee","Type":"ContainerStarted","Data":"7b2d7d0f941eed64d281ae78528ceb299d21a6b5c335e57d25c42bcf73b3aa3a"} Jun 02 20:02:31.082441 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:31.082418 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" Jun 02 20:02:31.084046 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:31.084028 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" Jun 02 20:02:31.097324 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:31.097284 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx" podStartSLOduration=30.071564308 podStartE2EDuration="40.097265411s" podCreationTimestamp="2026-06-02 20:01:51 +0000 UTC" firstStartedPulling="2026-06-02 20:02:20.543654244 +0000 UTC m=+35.388940190" lastFinishedPulling="2026-06-02 20:02:30.569355346 +0000 UTC m=+45.414641293" observedRunningTime="2026-06-02 20:02:31.096919925 +0000 UTC m=+45.942205896" watchObservedRunningTime="2026-06-02 20:02:31.097265411 +0000 UTC m=+45.942551379" Jun 02 20:02:31.143586 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:31.143438 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" podStartSLOduration=30.122980097 podStartE2EDuration="40.143417978s" podCreationTimestamp="2026-06-02 20:01:51 +0000 UTC" firstStartedPulling="2026-06-02 20:02:20.537710669 +0000 UTC m=+35.382996630" lastFinishedPulling="2026-06-02 20:02:30.558148551 +0000 UTC m=+45.403434511" observedRunningTime="2026-06-02 20:02:31.142389449 +0000 UTC m=+45.987675418" watchObservedRunningTime="2026-06-02 20:02:31.143417978 +0000 UTC m=+45.988703949" Jun 02 20:02:32.087443 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:32.087406 2562 generic.go:358] "Generic (PLEG): container finished" podID="f1e99a4e-cb86-4060-a831-fb5113477814" containerID="e42c30732973da03e284085d6486d8b6c69b8a7e52e7f08dd11c98847fd4d8ea" exitCode=0 Jun 02 20:02:32.088024 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:32.087489 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlr5w" event={"ID":"f1e99a4e-cb86-4060-a831-fb5113477814","Type":"ContainerDied","Data":"e42c30732973da03e284085d6486d8b6c69b8a7e52e7f08dd11c98847fd4d8ea"} Jun 02 20:02:33.092308 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:33.092273 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlr5w" event={"ID":"f1e99a4e-cb86-4060-a831-fb5113477814","Type":"ContainerStarted","Data":"e447b381c8abd6665ebe6a69d0a275faf51ace17088187b03638b1634f068f5f"} Jun 02 20:02:33.117908 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:33.117850 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vlr5w" podStartSLOduration=4.485766852 podStartE2EDuration="48.117836318s" podCreationTimestamp="2026-06-02 20:01:45 +0000 UTC" firstStartedPulling="2026-06-02 20:01:46.94045439 +0000 UTC m=+1.785740336" lastFinishedPulling="2026-06-02 20:02:30.572523853 +0000 UTC m=+45.417809802" observedRunningTime="2026-06-02 20:02:33.116771875 +0000 UTC m=+47.962057846" watchObservedRunningTime="2026-06-02 20:02:33.117836318 +0000 UTC m=+47.963122327" Jun 02 20:02:34.096035 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:34.095986 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" event={"ID":"c06a0fe8-3f02-4a19-8f45-0993755dab12","Type":"ContainerStarted","Data":"66fd9c2841a51b760fa8a3bba6879208abe828ee8fe296511c54159a4b0733e2"} Jun 02 20:02:34.096035 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:34.096039 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" event={"ID":"c06a0fe8-3f02-4a19-8f45-0993755dab12","Type":"ContainerStarted","Data":"82dae4a3544bf7455939a2d5d9625bc338716e97fe6665e7faa63d5972b723ba"} Jun 02 20:02:34.117339 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:34.117291 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" podStartSLOduration=30.142534772 podStartE2EDuration="43.117277434s" podCreationTimestamp="2026-06-02 20:01:51 +0000 UTC" firstStartedPulling="2026-06-02 20:02:20.537957477 +0000 UTC m=+35.383243434" lastFinishedPulling="2026-06-02 20:02:33.512700151 +0000 UTC m=+48.357986096" observedRunningTime="2026-06-02 20:02:34.115755427 +0000 UTC m=+48.961041395" watchObservedRunningTime="2026-06-02 20:02:34.117277434 +0000 UTC m=+48.962563436" Jun 02 20:02:35.910226 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:35.910185 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert\") pod \"ingress-canary-zvshg\" (UID: \"7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab\") " pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:02:35.910730 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:35.910262 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-btpl5\" (UID: \"b42cdcb3-9795-438c-9a98-8b3e4542f023\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:02:35.910730 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:35.910299 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:02:35.910730 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:35.910329 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:35.910730 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:35.910358 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 20:02:35.910730 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:35.910417 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 20:02:35.910730 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:35.910424 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 20:02:35.910730 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:35.910437 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert podName:7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab nodeName:}" failed. No retries permitted until 2026-06-02 20:02:51.910415599 +0000 UTC m=+66.755701551 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert") pod "ingress-canary-zvshg" (UID: "7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab") : secret "canary-serving-cert" not found Jun 02 20:02:35.910730 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:35.910440 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794f4fddd-wk9qz: secret "image-registry-tls" not found Jun 02 20:02:35.910730 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:35.910493 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert podName:b42cdcb3-9795-438c-9a98-8b3e4542f023 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:51.910479851 +0000 UTC m=+66.755765810 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-btpl5" (UID: "b42cdcb3-9795-438c-9a98-8b3e4542f023") : secret "networking-console-plugin-cert" not found Jun 02 20:02:35.910730 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:35.910423 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 20:02:35.910730 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:35.910512 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls podName:f666aa31-46ef-4136-8a69-425ae56881a3 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:51.910501336 +0000 UTC m=+66.755787282 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls") pod "image-registry-794f4fddd-wk9qz" (UID: "f666aa31-46ef-4136-8a69-425ae56881a3") : secret "image-registry-tls" not found Jun 02 20:02:35.910730 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:35.910541 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls podName:dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:51.910529521 +0000 UTC m=+66.755815467 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls") pod "dns-default-4ggh2" (UID: "dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5") : secret "dns-default-metrics-tls" not found Jun 02 20:02:36.615505 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:36.615452 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret\") pod \"global-pull-secret-syncer-dlshz\" (UID: \"a1f2dc2a-48b4-4ba7-b8e1-75f572e70485\") " pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:36.618924 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:36.618900 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1f2dc2a-48b4-4ba7-b8e1-75f572e70485-original-pull-secret\") pod \"global-pull-secret-syncer-dlshz\" (UID: \"a1f2dc2a-48b4-4ba7-b8e1-75f572e70485\") " pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:36.724514 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:36.724478 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlshz" Jun 02 20:02:36.847660 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:36.847629 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dlshz"] Jun 02 20:02:36.850939 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:02:36.850908 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f2dc2a_48b4_4ba7_b8e1_75f572e70485.slice/crio-8166ddb8f9745482f1d0217b874d73986e846f4b139bb434cb24358335f87f37 WatchSource:0}: Error finding container 8166ddb8f9745482f1d0217b874d73986e846f4b139bb434cb24358335f87f37: Status 404 returned error can't find the container with id 8166ddb8f9745482f1d0217b874d73986e846f4b139bb434cb24358335f87f37 Jun 02 20:02:37.102579 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:37.102543 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dlshz" event={"ID":"a1f2dc2a-48b4-4ba7-b8e1-75f572e70485","Type":"ContainerStarted","Data":"8166ddb8f9745482f1d0217b874d73986e846f4b139bb434cb24358335f87f37"} Jun 02 20:02:41.112060 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:41.112022 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dlshz" event={"ID":"a1f2dc2a-48b4-4ba7-b8e1-75f572e70485","Type":"ContainerStarted","Data":"ee13a3f8db774a2a3af3ae171f664029678a90f1dd0aa9fa036f1ad8ad425f2c"} Jun 02 20:02:41.128801 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:41.128751 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dlshz" podStartSLOduration=33.188192579 podStartE2EDuration="37.128736136s" podCreationTimestamp="2026-06-02 20:02:04 +0000 UTC" firstStartedPulling="2026-06-02 20:02:36.852581956 +0000 UTC m=+51.697867903" lastFinishedPulling="2026-06-02 20:02:40.793125514 +0000 UTC m=+55.638411460" observedRunningTime="2026-06-02 20:02:41.128578261 +0000 UTC m=+55.973864230" watchObservedRunningTime="2026-06-02 20:02:41.128736136 +0000 UTC m=+55.974022106" Jun 02 20:02:47.053499 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:47.053448 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qwd9g" Jun 02 20:02:50.427336 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:50.427295 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs\") pod \"network-metrics-daemon-dv4rg\" (UID: \"b3b653aa-519a-48d7-8d68-f907db391e06\") " pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:02:50.429908 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:50.429886 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 20:02:50.437960 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:50.437935 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 20:02:50.438011 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:50.438002 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs podName:b3b653aa-519a-48d7-8d68-f907db391e06 nodeName:}" failed. No retries permitted until 2026-06-02 20:03:54.437981866 +0000 UTC m=+129.283267812 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs") pod "network-metrics-daemon-dv4rg" (UID: "b3b653aa-519a-48d7-8d68-f907db391e06") : secret "metrics-daemon-secret" not found Jun 02 20:02:50.527936 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:50.527892 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxfb\" (UniqueName: \"kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb\") pod \"network-check-target-fflxg\" (UID: \"3c8a3790-7924-4560-8de5-36ab2806c8a2\") " pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:02:50.530712 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:50.530694 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 20:02:50.541093 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:50.541077 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 20:02:50.552058 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:50.552035 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxxfb\" (UniqueName: \"kubernetes.io/projected/3c8a3790-7924-4560-8de5-36ab2806c8a2-kube-api-access-pxxfb\") pod \"network-check-target-fflxg\" (UID: \"3c8a3790-7924-4560-8de5-36ab2806c8a2\") " pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:02:50.815897 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:50.815868 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vzgsf\"" Jun 02 20:02:50.823528 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:50.823502 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:02:50.946764 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:50.946734 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fflxg"] Jun 02 20:02:50.949819 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:02:50.949786 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c8a3790_7924_4560_8de5_36ab2806c8a2.slice/crio-b8071037d99f1ab1aa6b4187d1bfa55ce6a012a7bfe8fff77b63fa58832d0d75 WatchSource:0}: Error finding container b8071037d99f1ab1aa6b4187d1bfa55ce6a012a7bfe8fff77b63fa58832d0d75: Status 404 returned error can't find the container with id b8071037d99f1ab1aa6b4187d1bfa55ce6a012a7bfe8fff77b63fa58832d0d75 Jun 02 20:02:51.138867 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:51.138772 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fflxg" event={"ID":"3c8a3790-7924-4560-8de5-36ab2806c8a2","Type":"ContainerStarted","Data":"b8071037d99f1ab1aa6b4187d1bfa55ce6a012a7bfe8fff77b63fa58832d0d75"} Jun 02 20:02:51.938671 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:51.938628 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:02:51.939125 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:51.938677 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:02:51.939125 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:51.938721 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert\") pod \"ingress-canary-zvshg\" (UID: \"7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab\") " pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:02:51.939125 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:51.938788 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 20:02:51.939125 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:51.938836 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 20:02:51.939125 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:51.938843 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 20:02:51.939125 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:51.938854 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794f4fddd-wk9qz: secret "image-registry-tls" not found Jun 02 20:02:51.939125 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:51.938866 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 20:02:51.939125 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:51.938786 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-btpl5\" (UID: \"b42cdcb3-9795-438c-9a98-8b3e4542f023\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:02:51.939125 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:51.938870 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls podName:dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5 nodeName:}" failed. No retries permitted until 2026-06-02 20:03:23.938850045 +0000 UTC m=+98.784136007 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls") pod "dns-default-4ggh2" (UID: "dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5") : secret "dns-default-metrics-tls" not found Jun 02 20:02:51.939125 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:51.938943 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert podName:b42cdcb3-9795-438c-9a98-8b3e4542f023 nodeName:}" failed. No retries permitted until 2026-06-02 20:03:23.938921256 +0000 UTC m=+98.784207203 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-btpl5" (UID: "b42cdcb3-9795-438c-9a98-8b3e4542f023") : secret "networking-console-plugin-cert" not found Jun 02 20:02:51.939125 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:51.938964 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls podName:f666aa31-46ef-4136-8a69-425ae56881a3 nodeName:}" failed. No retries permitted until 2026-06-02 20:03:23.938952685 +0000 UTC m=+98.784238642 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls") pod "image-registry-794f4fddd-wk9qz" (UID: "f666aa31-46ef-4136-8a69-425ae56881a3") : secret "image-registry-tls" not found Jun 02 20:02:51.939125 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:02:51.938981 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert podName:7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab nodeName:}" failed. No retries permitted until 2026-06-02 20:03:23.938973313 +0000 UTC m=+98.784259262 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert") pod "ingress-canary-zvshg" (UID: "7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab") : secret "canary-serving-cert" not found Jun 02 20:02:56.154424 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:56.154389 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fflxg" event={"ID":"3c8a3790-7924-4560-8de5-36ab2806c8a2","Type":"ContainerStarted","Data":"42929c06caeae6b8404728f6329a15428515820f32fb765888f9abf5c5585abb"} Jun 02 20:02:56.154841 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:56.154525 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:02:56.172659 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:02:56.172609 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fflxg" podStartSLOduration=66.33246875 podStartE2EDuration="1m11.172594186s" podCreationTimestamp="2026-06-02 20:01:45 +0000 UTC" firstStartedPulling="2026-06-02 20:02:50.951848237 +0000 UTC m=+65.797134184" lastFinishedPulling="2026-06-02 20:02:55.79197367 +0000 UTC m=+70.637259620" observedRunningTime="2026-06-02 20:02:56.171982595 +0000 UTC m=+71.017268562" watchObservedRunningTime="2026-06-02 20:02:56.172594186 +0000 UTC m=+71.017880184" Jun 02 20:03:23.999238 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:03:23.999093 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-btpl5\" (UID: \"b42cdcb3-9795-438c-9a98-8b3e4542f023\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:03:23.999238 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:03:23.999165 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:03:23.999238 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:03:23.999187 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:03:23.999238 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:03:23.999213 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert\") pod \"ingress-canary-zvshg\" (UID: \"7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab\") " pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:03:23.999860 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:03:23.999249 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 20:03:23.999860 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:03:23.999297 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 20:03:23.999860 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:03:23.999314 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 20:03:23.999860 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:03:23.999342 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 20:03:23.999860 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:03:23.999362 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794f4fddd-wk9qz: secret "image-registry-tls" not found Jun 02 20:03:23.999860 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:03:23.999348 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert podName:b42cdcb3-9795-438c-9a98-8b3e4542f023 nodeName:}" failed. No retries permitted until 2026-06-02 20:04:27.999327163 +0000 UTC m=+162.844613127 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-btpl5" (UID: "b42cdcb3-9795-438c-9a98-8b3e4542f023") : secret "networking-console-plugin-cert" not found Jun 02 20:03:23.999860 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:03:23.999422 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls podName:dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5 nodeName:}" failed. No retries permitted until 2026-06-02 20:04:27.999410294 +0000 UTC m=+162.844696239 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls") pod "dns-default-4ggh2" (UID: "dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5") : secret "dns-default-metrics-tls" not found Jun 02 20:03:23.999860 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:03:23.999438 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert podName:7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab nodeName:}" failed. No retries permitted until 2026-06-02 20:04:27.999428668 +0000 UTC m=+162.844714619 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert") pod "ingress-canary-zvshg" (UID: "7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab") : secret "canary-serving-cert" not found Jun 02 20:03:23.999860 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:03:23.999452 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls podName:f666aa31-46ef-4136-8a69-425ae56881a3 nodeName:}" failed. No retries permitted until 2026-06-02 20:04:27.999444365 +0000 UTC m=+162.844730317 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls") pod "image-registry-794f4fddd-wk9qz" (UID: "f666aa31-46ef-4136-8a69-425ae56881a3") : secret "image-registry-tls" not found Jun 02 20:03:27.159803 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:03:27.159772 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fflxg" Jun 02 20:03:54.530503 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:03:54.530424 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs\") pod \"network-metrics-daemon-dv4rg\" (UID: \"b3b653aa-519a-48d7-8d68-f907db391e06\") " pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:03:54.530998 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:03:54.530585 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 20:03:54.530998 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:03:54.530660 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs podName:b3b653aa-519a-48d7-8d68-f907db391e06 nodeName:}" failed. No retries permitted until 2026-06-02 20:05:56.530641394 +0000 UTC m=+251.375927341 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs") pod "network-metrics-daemon-dv4rg" (UID: "b3b653aa-519a-48d7-8d68-f907db391e06") : secret "metrics-daemon-secret" not found Jun 02 20:04:22.559118 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:22.559092 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wc9fq_3550fef2-7bdf-4f39-b59b-38be4c78fc52/dns-node-resolver/0.log" Jun 02 20:04:23.021841 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:04:23.021741 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" podUID="f666aa31-46ef-4136-8a69-425ae56881a3" Jun 02 20:04:23.033805 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:04:23.033771 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" podUID="b42cdcb3-9795-438c-9a98-8b3e4542f023" Jun 02 20:04:23.083427 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:04:23.083355 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4ggh2" podUID="dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5" Jun 02 20:04:23.088515 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:04:23.088494 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-zvshg" podUID="7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab" Jun 02 20:04:23.353796 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:23.353771 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vszcp_a92766b7-de27-4a9c-8ec8-f55cbc5b26b8/node-ca/0.log" Jun 02 20:04:23.359670 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:23.359638 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:04:23.359670 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:23.359668 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:04:23.359890 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:23.359644 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4ggh2" Jun 02 20:04:23.359890 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:23.359638 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:04:24.731476 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:04:24.731421 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dv4rg" podUID="b3b653aa-519a-48d7-8d68-f907db391e06" Jun 02 20:04:28.094024 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:28.093973 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:04:28.094024 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:28.094029 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls\") pod \"image-registry-794f4fddd-wk9qz\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:04:28.094639 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:28.094058 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert\") pod \"ingress-canary-zvshg\" (UID: \"7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab\") " pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:04:28.094639 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:28.094101 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-btpl5\" (UID: \"b42cdcb3-9795-438c-9a98-8b3e4542f023\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:04:28.094639 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:04:28.094182 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 20:04:28.094639 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:04:28.094209 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 20:04:28.094639 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:04:28.094233 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-794f4fddd-wk9qz: secret "image-registry-tls" not found Jun 02 20:04:28.094639 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:04:28.094258 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert podName:7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab nodeName:}" failed. No retries permitted until 2026-06-02 20:06:30.094243479 +0000 UTC m=+284.939529439 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert") pod "ingress-canary-zvshg" (UID: "7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab") : secret "canary-serving-cert" not found Jun 02 20:04:28.094639 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:04:28.094271 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 20:04:28.094639 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:04:28.094289 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls podName:f666aa31-46ef-4136-8a69-425ae56881a3 nodeName:}" failed. No retries permitted until 2026-06-02 20:06:30.094270966 +0000 UTC m=+284.939556915 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls") pod "image-registry-794f4fddd-wk9qz" (UID: "f666aa31-46ef-4136-8a69-425ae56881a3") : secret "image-registry-tls" not found Jun 02 20:04:28.094639 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:04:28.094320 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert podName:b42cdcb3-9795-438c-9a98-8b3e4542f023 nodeName:}" failed. No retries permitted until 2026-06-02 20:06:30.09430476 +0000 UTC m=+284.939590710 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-btpl5" (UID: "b42cdcb3-9795-438c-9a98-8b3e4542f023") : secret "networking-console-plugin-cert" not found Jun 02 20:04:28.096376 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:28.096357 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5-metrics-tls\") pod \"dns-default-4ggh2\" (UID: \"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5\") " pod="openshift-dns/dns-default-4ggh2" Jun 02 20:04:28.163052 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:28.163020 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gclhs\"" Jun 02 20:04:28.171024 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:28.170999 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4ggh2" Jun 02 20:04:28.297555 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:28.297522 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4ggh2"] Jun 02 20:04:28.301421 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:04:28.301385 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddba65ee7_73d9_4a4b_893b_b7c8f9c6d1d5.slice/crio-2fad4815140bccc331e39e51f6ecc949b645852e3870dbf5ffd6b182da200c9b WatchSource:0}: Error finding container 2fad4815140bccc331e39e51f6ecc949b645852e3870dbf5ffd6b182da200c9b: Status 404 returned error can't find the container with id 2fad4815140bccc331e39e51f6ecc949b645852e3870dbf5ffd6b182da200c9b Jun 02 20:04:28.372809 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:28.372716 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4ggh2" event={"ID":"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5","Type":"ContainerStarted","Data":"2fad4815140bccc331e39e51f6ecc949b645852e3870dbf5ffd6b182da200c9b"} Jun 02 20:04:30.379194 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:30.379152 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4ggh2" event={"ID":"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5","Type":"ContainerStarted","Data":"d31cdf6849723200c16ba54c97f65ebe852071b347b33e016e63518f005ea5a9"} Jun 02 20:04:30.379194 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:30.379199 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4ggh2" event={"ID":"dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5","Type":"ContainerStarted","Data":"a173d37fc3d0e70a2b1ff33b933e0446335a664eb520c37908d360313d1cf253"} Jun 02 20:04:30.379637 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:30.379294 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4ggh2" Jun 02 20:04:30.398848 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:30.398801 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-4ggh2" podStartSLOduration=128.870952126 podStartE2EDuration="2m10.398786421s" podCreationTimestamp="2026-06-02 20:02:20 +0000 UTC" firstStartedPulling="2026-06-02 20:04:28.303181145 +0000 UTC m=+163.148467091" lastFinishedPulling="2026-06-02 20:04:29.83101544 +0000 UTC m=+164.676301386" observedRunningTime="2026-06-02 20:04:30.397981642 +0000 UTC m=+165.243267633" watchObservedRunningTime="2026-06-02 20:04:30.398786421 +0000 UTC m=+165.244072388" Jun 02 20:04:31.082917 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:31.082874 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" podUID="7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.8:8000/readyz\": dial tcp 10.132.0.8:8000: connect: connection refused" Jun 02 20:04:31.382942 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:31.382849 2562 generic.go:358] "Generic (PLEG): container finished" podID="3e80e5c0-6038-4be8-9f83-abc280066c95" containerID="9f357685a526b9561cc02f2592c249ff8f1fdb0650e0aed7b01ebe502e61ded2" exitCode=255 Jun 02 20:04:31.382942 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:31.382927 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx" event={"ID":"3e80e5c0-6038-4be8-9f83-abc280066c95","Type":"ContainerDied","Data":"9f357685a526b9561cc02f2592c249ff8f1fdb0650e0aed7b01ebe502e61ded2"} Jun 02 20:04:31.383476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:31.383312 2562 scope.go:117] "RemoveContainer" containerID="9f357685a526b9561cc02f2592c249ff8f1fdb0650e0aed7b01ebe502e61ded2" Jun 02 20:04:31.384283 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:31.384259 2562 generic.go:358] "Generic (PLEG): container finished" podID="7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee" containerID="7b2d7d0f941eed64d281ae78528ceb299d21a6b5c335e57d25c42bcf73b3aa3a" exitCode=1 Jun 02 20:04:31.384353 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:31.384327 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" event={"ID":"7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee","Type":"ContainerDied","Data":"7b2d7d0f941eed64d281ae78528ceb299d21a6b5c335e57d25c42bcf73b3aa3a"} Jun 02 20:04:31.384859 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:31.384749 2562 scope.go:117] "RemoveContainer" containerID="7b2d7d0f941eed64d281ae78528ceb299d21a6b5c335e57d25c42bcf73b3aa3a" Jun 02 20:04:32.388417 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:32.388377 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54db9b7f4d-rgmmx" event={"ID":"3e80e5c0-6038-4be8-9f83-abc280066c95","Type":"ContainerStarted","Data":"a4596758b3b799c98568a234049fca47d636e633fc256f123a1e5290b47f4e7d"} Jun 02 20:04:32.389989 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:32.389965 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" event={"ID":"7ea27dbe-4e2f-4aa2-beaa-72542d4d1cee","Type":"ContainerStarted","Data":"255d4fb69af30ffc7962ba67a76090adbc9c90bd6bcf3dc7b54d4e8b8a019583"} Jun 02 20:04:32.390236 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:32.390219 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" Jun 02 20:04:32.390826 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:32.390803 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7649755c47-lq9ms" Jun 02 20:04:38.694720 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:38.694672 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:04:40.386811 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:40.386785 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4ggh2" Jun 02 20:04:42.588103 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.588071 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v8648"] Jun 02 20:04:42.591123 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.591105 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v8648" Jun 02 20:04:42.593544 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.593523 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 20:04:42.596056 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.596029 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 20:04:42.596173 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.596038 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9rtd6\"" Jun 02 20:04:42.596246 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.596183 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 20:04:42.596422 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.596406 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 20:04:42.600881 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.600862 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2qv5\" (UniqueName: \"kubernetes.io/projected/b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1-kube-api-access-c2qv5\") pod \"insights-runtime-extractor-v8648\" (UID: \"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1\") " pod="openshift-insights/insights-runtime-extractor-v8648" Jun 02 20:04:42.600961 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.600911 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8648\" (UID: \"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1\") " pod="openshift-insights/insights-runtime-extractor-v8648" Jun 02 20:04:42.601011 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.600974 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8648\" (UID: \"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1\") " pod="openshift-insights/insights-runtime-extractor-v8648" Jun 02 20:04:42.601055 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.601025 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1-crio-socket\") pod \"insights-runtime-extractor-v8648\" (UID: \"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1\") " pod="openshift-insights/insights-runtime-extractor-v8648" Jun 02 20:04:42.601098 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.601062 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1-data-volume\") pod \"insights-runtime-extractor-v8648\" (UID: \"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1\") " pod="openshift-insights/insights-runtime-extractor-v8648" Jun 02 20:04:42.606742 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.606721 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v8648"] Jun 02 20:04:42.701668 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.701631 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1-crio-socket\") pod \"insights-runtime-extractor-v8648\" (UID: \"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1\") " pod="openshift-insights/insights-runtime-extractor-v8648" Jun 02 20:04:42.701668 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.701685 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1-data-volume\") pod \"insights-runtime-extractor-v8648\" (UID: \"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1\") " pod="openshift-insights/insights-runtime-extractor-v8648" Jun 02 20:04:42.702000 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.701770 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1-crio-socket\") pod \"insights-runtime-extractor-v8648\" (UID: \"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1\") " pod="openshift-insights/insights-runtime-extractor-v8648" Jun 02 20:04:42.702000 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.701851 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2qv5\" (UniqueName: \"kubernetes.io/projected/b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1-kube-api-access-c2qv5\") pod \"insights-runtime-extractor-v8648\" (UID: \"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1\") " pod="openshift-insights/insights-runtime-extractor-v8648" Jun 02 20:04:42.702000 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.701914 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8648\" (UID: \"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1\") " pod="openshift-insights/insights-runtime-extractor-v8648" Jun 02 20:04:42.702000 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.701950 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8648\" (UID: \"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1\") " pod="openshift-insights/insights-runtime-extractor-v8648" Jun 02 20:04:42.702163 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.702023 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1-data-volume\") pod \"insights-runtime-extractor-v8648\" (UID: \"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1\") " pod="openshift-insights/insights-runtime-extractor-v8648" Jun 02 20:04:42.702385 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.702357 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v8648\" (UID: \"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1\") " pod="openshift-insights/insights-runtime-extractor-v8648" Jun 02 20:04:42.704334 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.704315 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v8648\" (UID: \"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1\") " pod="openshift-insights/insights-runtime-extractor-v8648" Jun 02 20:04:42.719018 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.718974 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2qv5\" (UniqueName: \"kubernetes.io/projected/b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1-kube-api-access-c2qv5\") pod \"insights-runtime-extractor-v8648\" (UID: \"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1\") " pod="openshift-insights/insights-runtime-extractor-v8648" Jun 02 20:04:42.900001 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:42.899894 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v8648" Jun 02 20:04:43.029406 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:43.029368 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v8648"] Jun 02 20:04:43.034585 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:04:43.034557 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1aa6d34_6a97_4320_a37e_eeb5faa9e3b1.slice/crio-b90b76cd8b6c291d28980e090ba86c510368db9d6129f4dc8e587c4ea0cf68d2 WatchSource:0}: Error finding container b90b76cd8b6c291d28980e090ba86c510368db9d6129f4dc8e587c4ea0cf68d2: Status 404 returned error can't find the container with id b90b76cd8b6c291d28980e090ba86c510368db9d6129f4dc8e587c4ea0cf68d2 Jun 02 20:04:43.421166 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:43.421133 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v8648" event={"ID":"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1","Type":"ContainerStarted","Data":"af20bca1726959b12ccafae4dc1ff1a42ed851b843629e1f36c548e03d5eab58"} Jun 02 20:04:43.421166 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:43.421169 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v8648" event={"ID":"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1","Type":"ContainerStarted","Data":"b90b76cd8b6c291d28980e090ba86c510368db9d6129f4dc8e587c4ea0cf68d2"} Jun 02 20:04:44.425614 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:44.425577 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v8648" event={"ID":"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1","Type":"ContainerStarted","Data":"a77d7cbc33cbcf3ac6f02c8ef7adafdffa192c54139273c6230da15451935401"} Jun 02 20:04:46.432658 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:46.432619 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v8648" event={"ID":"b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1","Type":"ContainerStarted","Data":"c3a0eafe1ec693476b2704e88af472496de5c82b9de57f7616d063b0fad9c192"} Jun 02 20:04:46.451415 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:46.451368 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v8648" podStartSLOduration=2.129640403 podStartE2EDuration="4.451354875s" podCreationTimestamp="2026-06-02 20:04:42 +0000 UTC" firstStartedPulling="2026-06-02 20:04:43.087105035 +0000 UTC m=+177.932390984" lastFinishedPulling="2026-06-02 20:04:45.4088195 +0000 UTC m=+180.254105456" observedRunningTime="2026-06-02 20:04:46.449718284 +0000 UTC m=+181.295004253" watchObservedRunningTime="2026-06-02 20:04:46.451354875 +0000 UTC m=+181.296640821" Jun 02 20:04:59.786477 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:59.786422 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w84x6"] Jun 02 20:04:59.811707 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:59.811678 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:04:59.815110 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:59.815079 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 20:04:59.815261 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:59.815210 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 20:04:59.815261 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:59.815220 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 20:04:59.815541 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:59.815526 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 20:04:59.815840 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:59.815823 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gmdj2\"" Jun 02 20:04:59.815896 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:59.815866 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 20:04:59.815896 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:59.815869 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 20:04:59.930973 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:59.930941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41154016-7179-4eb5-9482-90f11a9ef100-metrics-client-ca\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:04:59.931154 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:59.930988 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ltf4\" (UniqueName: \"kubernetes.io/projected/41154016-7179-4eb5-9482-90f11a9ef100-kube-api-access-9ltf4\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:04:59.931154 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:59.931053 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41154016-7179-4eb5-9482-90f11a9ef100-node-exporter-accelerators-collector-config\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:04:59.931154 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:59.931102 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41154016-7179-4eb5-9482-90f11a9ef100-node-exporter-wtmp\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:04:59.931154 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:59.931126 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41154016-7179-4eb5-9482-90f11a9ef100-node-exporter-textfile\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:04:59.931373 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:59.931228 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41154016-7179-4eb5-9482-90f11a9ef100-sys\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:04:59.931373 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:59.931262 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41154016-7179-4eb5-9482-90f11a9ef100-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:04:59.931373 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:59.931295 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41154016-7179-4eb5-9482-90f11a9ef100-root\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:04:59.931373 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:04:59.931341 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41154016-7179-4eb5-9482-90f11a9ef100-node-exporter-tls\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.032773 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.032734 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41154016-7179-4eb5-9482-90f11a9ef100-root\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.032773 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.032778 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41154016-7179-4eb5-9482-90f11a9ef100-node-exporter-tls\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.033010 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.032823 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41154016-7179-4eb5-9482-90f11a9ef100-metrics-client-ca\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.033010 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.032845 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41154016-7179-4eb5-9482-90f11a9ef100-root\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.033010 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.032851 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ltf4\" (UniqueName: \"kubernetes.io/projected/41154016-7179-4eb5-9482-90f11a9ef100-kube-api-access-9ltf4\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.033010 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.032913 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41154016-7179-4eb5-9482-90f11a9ef100-node-exporter-accelerators-collector-config\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.033010 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.032946 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41154016-7179-4eb5-9482-90f11a9ef100-node-exporter-wtmp\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.033010 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.032968 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41154016-7179-4eb5-9482-90f11a9ef100-node-exporter-textfile\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.033010 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:05:00.032980 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 20:05:00.033346 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:05:00.033042 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41154016-7179-4eb5-9482-90f11a9ef100-node-exporter-tls podName:41154016-7179-4eb5-9482-90f11a9ef100 nodeName:}" failed. No retries permitted until 2026-06-02 20:05:00.53302375 +0000 UTC m=+195.378309696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/41154016-7179-4eb5-9482-90f11a9ef100-node-exporter-tls") pod "node-exporter-w84x6" (UID: "41154016-7179-4eb5-9482-90f11a9ef100") : secret "node-exporter-tls" not found Jun 02 20:05:00.033346 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.033117 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41154016-7179-4eb5-9482-90f11a9ef100-node-exporter-wtmp\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.033346 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.033180 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41154016-7179-4eb5-9482-90f11a9ef100-sys\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.033346 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.033202 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41154016-7179-4eb5-9482-90f11a9ef100-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.033346 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.033283 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41154016-7179-4eb5-9482-90f11a9ef100-sys\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.033540 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.033353 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41154016-7179-4eb5-9482-90f11a9ef100-node-exporter-textfile\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.033540 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.033499 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41154016-7179-4eb5-9482-90f11a9ef100-metrics-client-ca\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.033613 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.033553 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41154016-7179-4eb5-9482-90f11a9ef100-node-exporter-accelerators-collector-config\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.035580 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.035562 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41154016-7179-4eb5-9482-90f11a9ef100-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.044765 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.044708 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ltf4\" (UniqueName: \"kubernetes.io/projected/41154016-7179-4eb5-9482-90f11a9ef100-kube-api-access-9ltf4\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.538573 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.538542 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41154016-7179-4eb5-9482-90f11a9ef100-node-exporter-tls\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.541075 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.541048 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41154016-7179-4eb5-9482-90f11a9ef100-node-exporter-tls\") pod \"node-exporter-w84x6\" (UID: \"41154016-7179-4eb5-9482-90f11a9ef100\") " pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.720679 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:00.720644 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w84x6" Jun 02 20:05:00.728826 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:05:00.728786 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41154016_7179_4eb5_9482_90f11a9ef100.slice/crio-2e021f135d0a21f868ce4ed527a34110b322c16b4bf77a8090545f35d917dc81 WatchSource:0}: Error finding container 2e021f135d0a21f868ce4ed527a34110b322c16b4bf77a8090545f35d917dc81: Status 404 returned error can't find the container with id 2e021f135d0a21f868ce4ed527a34110b322c16b4bf77a8090545f35d917dc81 Jun 02 20:05:01.468198 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:01.468163 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w84x6" event={"ID":"41154016-7179-4eb5-9482-90f11a9ef100","Type":"ContainerStarted","Data":"2e021f135d0a21f868ce4ed527a34110b322c16b4bf77a8090545f35d917dc81"} Jun 02 20:05:02.471799 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:02.471762 2562 generic.go:358] "Generic (PLEG): container finished" podID="41154016-7179-4eb5-9482-90f11a9ef100" containerID="0db6615449733ecd187cde7452ab1dad9df74850f574db9c96ee7c2a00165dfb" exitCode=0 Jun 02 20:05:02.472200 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:02.471825 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w84x6" event={"ID":"41154016-7179-4eb5-9482-90f11a9ef100","Type":"ContainerDied","Data":"0db6615449733ecd187cde7452ab1dad9df74850f574db9c96ee7c2a00165dfb"} Jun 02 20:05:03.476012 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:03.475972 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w84x6" event={"ID":"41154016-7179-4eb5-9482-90f11a9ef100","Type":"ContainerStarted","Data":"40a091435f77e21da123453cd56eee961a32ff65e5623431bed2184c3f7bb3a6"} Jun 02 20:05:03.476012 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:03.476014 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w84x6" event={"ID":"41154016-7179-4eb5-9482-90f11a9ef100","Type":"ContainerStarted","Data":"e4dd57d0f0271238c5c7866d84a39d3583c63d7759479cf8a4e17b1b15e28cfc"} Jun 02 20:05:03.500276 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:03.500206 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w84x6" podStartSLOduration=3.492636213 podStartE2EDuration="4.500190925s" podCreationTimestamp="2026-06-02 20:04:59 +0000 UTC" firstStartedPulling="2026-06-02 20:05:00.730689054 +0000 UTC m=+195.575975000" lastFinishedPulling="2026-06-02 20:05:01.738243752 +0000 UTC m=+196.583529712" observedRunningTime="2026-06-02 20:05:03.499488808 +0000 UTC m=+198.344774773" watchObservedRunningTime="2026-06-02 20:05:03.500190925 +0000 UTC m=+198.345476892" Jun 02 20:05:04.332432 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.332399 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-794f4fddd-wk9qz"] Jun 02 20:05:04.336123 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:05:04.333430 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" podUID="f666aa31-46ef-4136-8a69-425ae56881a3" Jun 02 20:05:04.478045 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.478015 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:05:04.482368 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.482338 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:05:04.574771 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.574739 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f666aa31-46ef-4136-8a69-425ae56881a3-trusted-ca\") pod \"f666aa31-46ef-4136-8a69-425ae56881a3\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " Jun 02 20:05:04.574931 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.574781 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f666aa31-46ef-4136-8a69-425ae56881a3-image-registry-private-configuration\") pod \"f666aa31-46ef-4136-8a69-425ae56881a3\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " Jun 02 20:05:04.574931 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.574803 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f666aa31-46ef-4136-8a69-425ae56881a3-ca-trust-extracted\") pod \"f666aa31-46ef-4136-8a69-425ae56881a3\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " Jun 02 20:05:04.574931 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.574829 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-bound-sa-token\") pod \"f666aa31-46ef-4136-8a69-425ae56881a3\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " Jun 02 20:05:04.574931 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.574853 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f666aa31-46ef-4136-8a69-425ae56881a3-registry-certificates\") pod \"f666aa31-46ef-4136-8a69-425ae56881a3\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " Jun 02 20:05:04.574931 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.574881 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psmll\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-kube-api-access-psmll\") pod \"f666aa31-46ef-4136-8a69-425ae56881a3\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " Jun 02 20:05:04.574931 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.574904 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f666aa31-46ef-4136-8a69-425ae56881a3-installation-pull-secrets\") pod \"f666aa31-46ef-4136-8a69-425ae56881a3\" (UID: \"f666aa31-46ef-4136-8a69-425ae56881a3\") " Jun 02 20:05:04.575403 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.575276 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f666aa31-46ef-4136-8a69-425ae56881a3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f666aa31-46ef-4136-8a69-425ae56881a3" (UID: "f666aa31-46ef-4136-8a69-425ae56881a3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:05:04.575403 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.575195 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f666aa31-46ef-4136-8a69-425ae56881a3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f666aa31-46ef-4136-8a69-425ae56881a3" (UID: "f666aa31-46ef-4136-8a69-425ae56881a3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:05:04.575403 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.575352 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f666aa31-46ef-4136-8a69-425ae56881a3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f666aa31-46ef-4136-8a69-425ae56881a3" (UID: "f666aa31-46ef-4136-8a69-425ae56881a3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:05:04.575638 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.575596 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f666aa31-46ef-4136-8a69-425ae56881a3-trusted-ca\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:05:04.575638 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.575616 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f666aa31-46ef-4136-8a69-425ae56881a3-ca-trust-extracted\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:05:04.575638 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.575632 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f666aa31-46ef-4136-8a69-425ae56881a3-registry-certificates\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:05:04.577351 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.577320 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f666aa31-46ef-4136-8a69-425ae56881a3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f666aa31-46ef-4136-8a69-425ae56881a3" (UID: "f666aa31-46ef-4136-8a69-425ae56881a3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:05:04.577521 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.577498 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f666aa31-46ef-4136-8a69-425ae56881a3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f666aa31-46ef-4136-8a69-425ae56881a3" (UID: "f666aa31-46ef-4136-8a69-425ae56881a3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:05:04.577590 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.577563 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-kube-api-access-psmll" (OuterVolumeSpecName: "kube-api-access-psmll") pod "f666aa31-46ef-4136-8a69-425ae56881a3" (UID: "f666aa31-46ef-4136-8a69-425ae56881a3"). InnerVolumeSpecName "kube-api-access-psmll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:05:04.577590 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.577579 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f666aa31-46ef-4136-8a69-425ae56881a3" (UID: "f666aa31-46ef-4136-8a69-425ae56881a3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:05:04.677090 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.677008 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f666aa31-46ef-4136-8a69-425ae56881a3-image-registry-private-configuration\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:05:04.677090 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.677039 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-bound-sa-token\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:05:04.677090 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.677049 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psmll\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-kube-api-access-psmll\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:05:04.677090 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:04.677058 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f666aa31-46ef-4136-8a69-425ae56881a3-installation-pull-secrets\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:05:05.480863 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:05.480829 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-794f4fddd-wk9qz" Jun 02 20:05:05.513675 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:05.513640 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-794f4fddd-wk9qz"] Jun 02 20:05:05.517474 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:05.517428 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-794f4fddd-wk9qz"] Jun 02 20:05:05.584565 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:05.584537 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f666aa31-46ef-4136-8a69-425ae56881a3-registry-tls\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:05:05.697744 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:05.697709 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f666aa31-46ef-4136-8a69-425ae56881a3" path="/var/lib/kubelet/pods/f666aa31-46ef-4136-8a69-425ae56881a3/volumes" Jun 02 20:05:20.367421 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:20.367364 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" podUID="c06a0fe8-3f02-4a19-8f45-0993755dab12" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 20:05:30.367351 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:30.367311 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" podUID="c06a0fe8-3f02-4a19-8f45-0993755dab12" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 20:05:40.367406 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:40.367357 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" podUID="c06a0fe8-3f02-4a19-8f45-0993755dab12" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 20:05:40.367867 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:40.367448 2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" Jun 02 20:05:40.368044 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:40.368013 2562 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"66fd9c2841a51b760fa8a3bba6879208abe828ee8fe296511c54159a4b0733e2"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 02 20:05:40.368096 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:40.368071 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" podUID="c06a0fe8-3f02-4a19-8f45-0993755dab12" containerName="service-proxy" containerID="cri-o://66fd9c2841a51b760fa8a3bba6879208abe828ee8fe296511c54159a4b0733e2" gracePeriod=30 Jun 02 20:05:40.570041 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:40.570003 2562 generic.go:358] "Generic (PLEG): container finished" podID="c06a0fe8-3f02-4a19-8f45-0993755dab12" containerID="66fd9c2841a51b760fa8a3bba6879208abe828ee8fe296511c54159a4b0733e2" exitCode=2 Jun 02 20:05:40.570217 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:40.570039 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" event={"ID":"c06a0fe8-3f02-4a19-8f45-0993755dab12","Type":"ContainerDied","Data":"66fd9c2841a51b760fa8a3bba6879208abe828ee8fe296511c54159a4b0733e2"} Jun 02 20:05:40.570217 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:40.570091 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6d76fcf4-cbwkw" event={"ID":"c06a0fe8-3f02-4a19-8f45-0993755dab12","Type":"ContainerStarted","Data":"5c1c3abc62b03d4f305695c0028b9ebced82b5d6bf0964c0cb197fbfdacd5d3f"} Jun 02 20:05:56.581522 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:56.581483 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs\") pod \"network-metrics-daemon-dv4rg\" (UID: \"b3b653aa-519a-48d7-8d68-f907db391e06\") " pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:05:56.583885 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:56.583861 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3b653aa-519a-48d7-8d68-f907db391e06-metrics-certs\") pod \"network-metrics-daemon-dv4rg\" (UID: \"b3b653aa-519a-48d7-8d68-f907db391e06\") " pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:05:56.697931 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:56.697901 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s8fv6\"" Jun 02 20:05:56.706080 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:56.706058 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dv4rg" Jun 02 20:05:56.828168 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:56.828134 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dv4rg"] Jun 02 20:05:56.832151 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:05:56.832086 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3b653aa_519a_48d7_8d68_f907db391e06.slice/crio-60568742da0b3d5be97ac5058b74e59e89b3b233a57f6fc32698b46179af969c WatchSource:0}: Error finding container 60568742da0b3d5be97ac5058b74e59e89b3b233a57f6fc32698b46179af969c: Status 404 returned error can't find the container with id 60568742da0b3d5be97ac5058b74e59e89b3b233a57f6fc32698b46179af969c Jun 02 20:05:57.614209 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:57.614168 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dv4rg" event={"ID":"b3b653aa-519a-48d7-8d68-f907db391e06","Type":"ContainerStarted","Data":"60568742da0b3d5be97ac5058b74e59e89b3b233a57f6fc32698b46179af969c"} Jun 02 20:05:58.619025 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:58.618984 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dv4rg" event={"ID":"b3b653aa-519a-48d7-8d68-f907db391e06","Type":"ContainerStarted","Data":"2fc3143b44377ab070f2630ec8d17d2e8bbd0acdfd9973e241c08c977910f4b4"} Jun 02 20:05:58.619025 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:58.619026 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dv4rg" event={"ID":"b3b653aa-519a-48d7-8d68-f907db391e06","Type":"ContainerStarted","Data":"d14bb45d1f0415d3f52b46ebccacdedb6cf32a16867f3e0adae4e00e11da458f"} Jun 02 20:05:58.636981 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:05:58.636931 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dv4rg" podStartSLOduration=252.238981838 podStartE2EDuration="4m13.636918005s" podCreationTimestamp="2026-06-02 20:01:45 +0000 UTC" firstStartedPulling="2026-06-02 20:05:56.83394389 +0000 UTC m=+251.679229836" lastFinishedPulling="2026-06-02 20:05:58.231880057 +0000 UTC m=+253.077166003" observedRunningTime="2026-06-02 20:05:58.636002679 +0000 UTC m=+253.481288658" watchObservedRunningTime="2026-06-02 20:05:58.636918005 +0000 UTC m=+253.482204017" Jun 02 20:06:26.361069 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:06:26.361018 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" podUID="b42cdcb3-9795-438c-9a98-8b3e4542f023" Jun 02 20:06:26.361069 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:06:26.361034 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-zvshg" podUID="7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab" Jun 02 20:06:26.687377 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:26.687301 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:06:26.687377 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:26.687345 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:06:30.144029 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:30.143988 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-btpl5\" (UID: \"b42cdcb3-9795-438c-9a98-8b3e4542f023\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:06:30.144540 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:30.144051 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert\") pod \"ingress-canary-zvshg\" (UID: \"7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab\") " pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:06:30.146712 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:30.146678 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b42cdcb3-9795-438c-9a98-8b3e4542f023-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-btpl5\" (UID: \"b42cdcb3-9795-438c-9a98-8b3e4542f023\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:06:30.146810 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:30.146678 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab-cert\") pod \"ingress-canary-zvshg\" (UID: \"7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab\") " pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:06:30.290641 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:30.290611 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hxgvv\"" Jun 02 20:06:30.290910 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:30.290892 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hqb8x\"" Jun 02 20:06:30.298505 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:30.298484 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zvshg" Jun 02 20:06:30.298608 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:30.298502 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" Jun 02 20:06:30.463770 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:30.463735 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5"] Jun 02 20:06:30.467334 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:06:30.467304 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb42cdcb3_9795_438c_9a98_8b3e4542f023.slice/crio-d2cb67102c605412c2de73c484be4a91435aa410b65c32eb7465039e1e06fdac WatchSource:0}: Error finding container d2cb67102c605412c2de73c484be4a91435aa410b65c32eb7465039e1e06fdac: Status 404 returned error can't find the container with id d2cb67102c605412c2de73c484be4a91435aa410b65c32eb7465039e1e06fdac Jun 02 20:06:30.476845 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:30.476823 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zvshg"] Jun 02 20:06:30.479628 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:06:30.479601 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f3e21f3_fbcd_45b6_b1b7_e84c88eaffab.slice/crio-56d8ed9ff59c4f2859833db337b59c23e46202e1cdf99917e3326a833d17695a WatchSource:0}: Error finding container 56d8ed9ff59c4f2859833db337b59c23e46202e1cdf99917e3326a833d17695a: Status 404 returned error can't find the container with id 56d8ed9ff59c4f2859833db337b59c23e46202e1cdf99917e3326a833d17695a Jun 02 20:06:30.697719 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:30.697621 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zvshg" event={"ID":"7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab","Type":"ContainerStarted","Data":"56d8ed9ff59c4f2859833db337b59c23e46202e1cdf99917e3326a833d17695a"} Jun 02 20:06:30.698619 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:30.698593 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" event={"ID":"b42cdcb3-9795-438c-9a98-8b3e4542f023","Type":"ContainerStarted","Data":"d2cb67102c605412c2de73c484be4a91435aa410b65c32eb7465039e1e06fdac"} Jun 02 20:06:32.704791 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:32.704753 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" event={"ID":"b42cdcb3-9795-438c-9a98-8b3e4542f023","Type":"ContainerStarted","Data":"992976c2ed171d653471effcc5a6a620a8632778affae2f0c2ca6e9dc4e45712"} Jun 02 20:06:32.706047 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:32.706021 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zvshg" event={"ID":"7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab","Type":"ContainerStarted","Data":"3850283a00e0549bd645d0d65ab0077be10e67cb5a52d1e20298e1dd184555ec"} Jun 02 20:06:32.723679 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:32.723631 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-btpl5" podStartSLOduration=276.494345767 podStartE2EDuration="4m37.723614875s" podCreationTimestamp="2026-06-02 20:01:55 +0000 UTC" firstStartedPulling="2026-06-02 20:06:30.469180341 +0000 UTC m=+285.314466302" lastFinishedPulling="2026-06-02 20:06:31.698449462 +0000 UTC m=+286.543735410" observedRunningTime="2026-06-02 20:06:32.722227122 +0000 UTC m=+287.567513091" watchObservedRunningTime="2026-06-02 20:06:32.723614875 +0000 UTC m=+287.568900842" Jun 02 20:06:32.738333 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:32.738275 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zvshg" podStartSLOduration=250.705809861 podStartE2EDuration="4m12.738256886s" podCreationTimestamp="2026-06-02 20:02:20 +0000 UTC" firstStartedPulling="2026-06-02 20:06:30.481177234 +0000 UTC m=+285.326463179" lastFinishedPulling="2026-06-02 20:06:32.513624256 +0000 UTC m=+287.358910204" observedRunningTime="2026-06-02 20:06:32.73778423 +0000 UTC m=+287.583070199" watchObservedRunningTime="2026-06-02 20:06:32.738256886 +0000 UTC m=+287.583542855" Jun 02 20:06:45.621092 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:06:45.621066 2562 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 20:09:12.155050 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:12.154970 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-skpm5"] Jun 02 20:09:12.158166 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:12.158144 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-skpm5" Jun 02 20:09:12.160482 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:12.160435 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 02 20:09:12.160601 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:12.160583 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zgscj\"" Jun 02 20:09:12.160658 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:12.160592 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 02 20:09:12.171653 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:12.171632 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-skpm5"] Jun 02 20:09:12.187741 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:12.187701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbdc7050-d032-49ca-8318-3cb7cd74a108-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-skpm5\" (UID: \"bbdc7050-d032-49ca-8318-3cb7cd74a108\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-skpm5" Jun 02 20:09:12.187869 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:12.187778 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjdq9\" (UniqueName: \"kubernetes.io/projected/bbdc7050-d032-49ca-8318-3cb7cd74a108-kube-api-access-fjdq9\") pod \"cert-manager-operator-controller-manager-54b9655956-skpm5\" (UID: \"bbdc7050-d032-49ca-8318-3cb7cd74a108\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-skpm5" Jun 02 20:09:12.288606 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:12.288568 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbdc7050-d032-49ca-8318-3cb7cd74a108-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-skpm5\" (UID: \"bbdc7050-d032-49ca-8318-3cb7cd74a108\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-skpm5" Jun 02 20:09:12.288756 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:12.288620 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fjdq9\" (UniqueName: \"kubernetes.io/projected/bbdc7050-d032-49ca-8318-3cb7cd74a108-kube-api-access-fjdq9\") pod \"cert-manager-operator-controller-manager-54b9655956-skpm5\" (UID: \"bbdc7050-d032-49ca-8318-3cb7cd74a108\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-skpm5" Jun 02 20:09:12.288996 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:12.288975 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbdc7050-d032-49ca-8318-3cb7cd74a108-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-skpm5\" (UID: \"bbdc7050-d032-49ca-8318-3cb7cd74a108\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-skpm5" Jun 02 20:09:12.299385 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:12.299351 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjdq9\" (UniqueName: \"kubernetes.io/projected/bbdc7050-d032-49ca-8318-3cb7cd74a108-kube-api-access-fjdq9\") pod \"cert-manager-operator-controller-manager-54b9655956-skpm5\" (UID: \"bbdc7050-d032-49ca-8318-3cb7cd74a108\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-skpm5" Jun 02 20:09:12.467013 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:12.466921 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-skpm5" Jun 02 20:09:12.602818 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:12.602776 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-skpm5"] Jun 02 20:09:12.606011 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:09:12.605978 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbdc7050_d032_49ca_8318_3cb7cd74a108.slice/crio-633b610df9ade7176810d7de974479af85f160f06786a22545ee430d6ab91cbb WatchSource:0}: Error finding container 633b610df9ade7176810d7de974479af85f160f06786a22545ee430d6ab91cbb: Status 404 returned error can't find the container with id 633b610df9ade7176810d7de974479af85f160f06786a22545ee430d6ab91cbb Jun 02 20:09:12.608512 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:12.608494 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 20:09:13.115102 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:13.115051 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-skpm5" event={"ID":"bbdc7050-d032-49ca-8318-3cb7cd74a108","Type":"ContainerStarted","Data":"633b610df9ade7176810d7de974479af85f160f06786a22545ee430d6ab91cbb"} Jun 02 20:09:14.118708 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:14.118674 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-skpm5" event={"ID":"bbdc7050-d032-49ca-8318-3cb7cd74a108","Type":"ContainerStarted","Data":"05ac2eb6b8d56f3529d8feb46b1527b6a97bdf7b1b0f5cc85a841dbbe570f540"} Jun 02 20:09:14.139558 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:14.139505 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-skpm5" podStartSLOduration=0.709994067 podStartE2EDuration="2.139490089s" podCreationTimestamp="2026-06-02 20:09:12 +0000 UTC" firstStartedPulling="2026-06-02 20:09:12.608624705 +0000 UTC m=+447.453910651" lastFinishedPulling="2026-06-02 20:09:14.038120727 +0000 UTC m=+448.883406673" observedRunningTime="2026-06-02 20:09:14.138343004 +0000 UTC m=+448.983628971" watchObservedRunningTime="2026-06-02 20:09:14.139490089 +0000 UTC m=+448.984776060" Jun 02 20:09:15.499377 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:15.499332 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb"] Jun 02 20:09:15.502586 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:15.502569 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb" Jun 02 20:09:15.505067 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:15.505047 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 20:09:15.505067 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:15.505062 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t9r55\"" Jun 02 20:09:15.505191 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:15.505047 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 20:09:15.512236 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:15.512214 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb"] Jun 02 20:09:15.616984 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:15.616944 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glzdv\" (UniqueName: \"kubernetes.io/projected/8b548882-0124-4062-a969-77591f376599-kube-api-access-glzdv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb\" (UID: \"8b548882-0124-4062-a969-77591f376599\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb" Jun 02 20:09:15.616984 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:15.616987 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b548882-0124-4062-a969-77591f376599-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb\" (UID: \"8b548882-0124-4062-a969-77591f376599\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb" Jun 02 20:09:15.617207 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:15.617012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b548882-0124-4062-a969-77591f376599-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb\" (UID: \"8b548882-0124-4062-a969-77591f376599\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb" Jun 02 20:09:15.717652 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:15.717622 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-glzdv\" (UniqueName: \"kubernetes.io/projected/8b548882-0124-4062-a969-77591f376599-kube-api-access-glzdv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb\" (UID: \"8b548882-0124-4062-a969-77591f376599\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb" Jun 02 20:09:15.717652 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:15.717660 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b548882-0124-4062-a969-77591f376599-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb\" (UID: \"8b548882-0124-4062-a969-77591f376599\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb" Jun 02 20:09:15.717856 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:15.717688 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b548882-0124-4062-a969-77591f376599-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb\" (UID: \"8b548882-0124-4062-a969-77591f376599\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb" Jun 02 20:09:15.718078 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:15.718060 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b548882-0124-4062-a969-77591f376599-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb\" (UID: \"8b548882-0124-4062-a969-77591f376599\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb" Jun 02 20:09:15.718119 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:15.718097 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b548882-0124-4062-a969-77591f376599-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb\" (UID: \"8b548882-0124-4062-a969-77591f376599\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb" Jun 02 20:09:15.739581 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:15.739552 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glzdv\" (UniqueName: \"kubernetes.io/projected/8b548882-0124-4062-a969-77591f376599-kube-api-access-glzdv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb\" (UID: \"8b548882-0124-4062-a969-77591f376599\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb" Jun 02 20:09:15.812097 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:15.812064 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb" Jun 02 20:09:15.941134 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:15.941096 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb"] Jun 02 20:09:15.944317 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:09:15.944288 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b548882_0124_4062_a969_77591f376599.slice/crio-3e7e6093c5680989fba51a6dedb3a3c4386812cffe755dd27b9bfa683896d7bd WatchSource:0}: Error finding container 3e7e6093c5680989fba51a6dedb3a3c4386812cffe755dd27b9bfa683896d7bd: Status 404 returned error can't find the container with id 3e7e6093c5680989fba51a6dedb3a3c4386812cffe755dd27b9bfa683896d7bd Jun 02 20:09:16.125043 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:16.124951 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb" event={"ID":"8b548882-0124-4062-a969-77591f376599","Type":"ContainerStarted","Data":"3e7e6093c5680989fba51a6dedb3a3c4386812cffe755dd27b9bfa683896d7bd"} Jun 02 20:09:24.150913 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:24.150873 2562 generic.go:358] "Generic (PLEG): container finished" podID="8b548882-0124-4062-a969-77591f376599" containerID="adfdd48ea64b31a2458a28aa64fc9f280227a0f267b791c97634b9442c8ee946" exitCode=0 Jun 02 20:09:24.151327 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:24.150931 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb" event={"ID":"8b548882-0124-4062-a969-77591f376599","Type":"ContainerDied","Data":"adfdd48ea64b31a2458a28aa64fc9f280227a0f267b791c97634b9442c8ee946"} Jun 02 20:09:27.160716 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:27.160683 2562 generic.go:358] "Generic (PLEG): container finished" podID="8b548882-0124-4062-a969-77591f376599" containerID="e048ee010fa968c6428e9b32052b5b01ba448cf82cab74bc24baaabede831abd" exitCode=0 Jun 02 20:09:27.161091 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:27.160768 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb" event={"ID":"8b548882-0124-4062-a969-77591f376599","Type":"ContainerDied","Data":"e048ee010fa968c6428e9b32052b5b01ba448cf82cab74bc24baaabede831abd"} Jun 02 20:09:35.183347 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:35.183298 2562 generic.go:358] "Generic (PLEG): container finished" podID="8b548882-0124-4062-a969-77591f376599" containerID="01a416a975c9f8b6b0823554c20f326e3571a2f73ae1e3cf8b434c0d5f8eecd3" exitCode=0 Jun 02 20:09:35.183757 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:35.183408 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb" event={"ID":"8b548882-0124-4062-a969-77591f376599","Type":"ContainerDied","Data":"01a416a975c9f8b6b0823554c20f326e3571a2f73ae1e3cf8b434c0d5f8eecd3"} Jun 02 20:09:36.309476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:36.309441 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb" Jun 02 20:09:36.377913 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:36.377881 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b548882-0124-4062-a969-77591f376599-util\") pod \"8b548882-0124-4062-a969-77591f376599\" (UID: \"8b548882-0124-4062-a969-77591f376599\") " Jun 02 20:09:36.378100 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:36.377937 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glzdv\" (UniqueName: \"kubernetes.io/projected/8b548882-0124-4062-a969-77591f376599-kube-api-access-glzdv\") pod \"8b548882-0124-4062-a969-77591f376599\" (UID: \"8b548882-0124-4062-a969-77591f376599\") " Jun 02 20:09:36.378100 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:36.377967 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b548882-0124-4062-a969-77591f376599-bundle\") pod \"8b548882-0124-4062-a969-77591f376599\" (UID: \"8b548882-0124-4062-a969-77591f376599\") " Jun 02 20:09:36.378347 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:36.378323 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b548882-0124-4062-a969-77591f376599-bundle" (OuterVolumeSpecName: "bundle") pod "8b548882-0124-4062-a969-77591f376599" (UID: "8b548882-0124-4062-a969-77591f376599"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:09:36.380166 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:36.380145 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b548882-0124-4062-a969-77591f376599-kube-api-access-glzdv" (OuterVolumeSpecName: "kube-api-access-glzdv") pod "8b548882-0124-4062-a969-77591f376599" (UID: "8b548882-0124-4062-a969-77591f376599"). InnerVolumeSpecName "kube-api-access-glzdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:09:36.382030 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:36.382007 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b548882-0124-4062-a969-77591f376599-util" (OuterVolumeSpecName: "util") pod "8b548882-0124-4062-a969-77591f376599" (UID: "8b548882-0124-4062-a969-77591f376599"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:09:36.478728 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:36.478638 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glzdv\" (UniqueName: \"kubernetes.io/projected/8b548882-0124-4062-a969-77591f376599-kube-api-access-glzdv\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:09:36.478728 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:36.478675 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b548882-0124-4062-a969-77591f376599-bundle\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:09:36.478728 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:36.478688 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b548882-0124-4062-a969-77591f376599-util\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:09:37.194799 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:37.194759 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb" event={"ID":"8b548882-0124-4062-a969-77591f376599","Type":"ContainerDied","Data":"3e7e6093c5680989fba51a6dedb3a3c4386812cffe755dd27b9bfa683896d7bd"} Jun 02 20:09:37.194799 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:37.194800 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e7e6093c5680989fba51a6dedb3a3c4386812cffe755dd27b9bfa683896d7bd" Jun 02 20:09:37.195005 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:37.194838 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2hcxb" Jun 02 20:09:46.871052 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:46.871016 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8"] Jun 02 20:09:46.871579 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:46.871237 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b548882-0124-4062-a969-77591f376599" containerName="extract" Jun 02 20:09:46.871579 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:46.871247 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b548882-0124-4062-a969-77591f376599" containerName="extract" Jun 02 20:09:46.871579 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:46.871261 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b548882-0124-4062-a969-77591f376599" containerName="pull" Jun 02 20:09:46.871579 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:46.871266 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b548882-0124-4062-a969-77591f376599" containerName="pull" Jun 02 20:09:46.871579 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:46.871276 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b548882-0124-4062-a969-77591f376599" containerName="util" Jun 02 20:09:46.871579 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:46.871283 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b548882-0124-4062-a969-77591f376599" containerName="util" Jun 02 20:09:46.871579 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:46.871324 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="8b548882-0124-4062-a969-77591f376599" containerName="extract" Jun 02 20:09:46.875440 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:46.875420 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8" Jun 02 20:09:46.878547 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:46.878524 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t9r55\"" Jun 02 20:09:46.878629 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:46.878569 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 20:09:46.878682 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:46.878629 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 20:09:46.882391 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:46.882176 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8"] Jun 02 20:09:46.957511 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:46.957474 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6ntw\" (UniqueName: \"kubernetes.io/projected/0fc4b24e-5854-4f6d-8098-87d377d8d46e-kube-api-access-c6ntw\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8\" (UID: \"0fc4b24e-5854-4f6d-8098-87d377d8d46e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8" Jun 02 20:09:46.957693 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:46.957563 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fc4b24e-5854-4f6d-8098-87d377d8d46e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8\" (UID: \"0fc4b24e-5854-4f6d-8098-87d377d8d46e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8" Jun 02 20:09:46.957693 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:46.957645 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fc4b24e-5854-4f6d-8098-87d377d8d46e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8\" (UID: \"0fc4b24e-5854-4f6d-8098-87d377d8d46e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8" Jun 02 20:09:47.058684 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:47.058649 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ntw\" (UniqueName: \"kubernetes.io/projected/0fc4b24e-5854-4f6d-8098-87d377d8d46e-kube-api-access-c6ntw\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8\" (UID: \"0fc4b24e-5854-4f6d-8098-87d377d8d46e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8" Jun 02 20:09:47.058880 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:47.058698 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fc4b24e-5854-4f6d-8098-87d377d8d46e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8\" (UID: \"0fc4b24e-5854-4f6d-8098-87d377d8d46e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8" Jun 02 20:09:47.058880 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:47.058747 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fc4b24e-5854-4f6d-8098-87d377d8d46e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8\" (UID: \"0fc4b24e-5854-4f6d-8098-87d377d8d46e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8" Jun 02 20:09:47.059144 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:47.059123 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fc4b24e-5854-4f6d-8098-87d377d8d46e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8\" (UID: \"0fc4b24e-5854-4f6d-8098-87d377d8d46e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8" Jun 02 20:09:47.059181 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:47.059137 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fc4b24e-5854-4f6d-8098-87d377d8d46e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8\" (UID: \"0fc4b24e-5854-4f6d-8098-87d377d8d46e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8" Jun 02 20:09:47.066861 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:47.066842 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6ntw\" (UniqueName: \"kubernetes.io/projected/0fc4b24e-5854-4f6d-8098-87d377d8d46e-kube-api-access-c6ntw\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8\" (UID: \"0fc4b24e-5854-4f6d-8098-87d377d8d46e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8" Jun 02 20:09:47.185523 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:47.185424 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8" Jun 02 20:09:47.311424 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:47.311389 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8"] Jun 02 20:09:47.313969 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:09:47.313937 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc4b24e_5854_4f6d_8098_87d377d8d46e.slice/crio-20b2382cc0cfaa7ebd455e75e980b353e9740d908f3438518e70570a69c4a38b WatchSource:0}: Error finding container 20b2382cc0cfaa7ebd455e75e980b353e9740d908f3438518e70570a69c4a38b: Status 404 returned error can't find the container with id 20b2382cc0cfaa7ebd455e75e980b353e9740d908f3438518e70570a69c4a38b Jun 02 20:09:48.226623 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:48.226592 2562 generic.go:358] "Generic (PLEG): container finished" podID="0fc4b24e-5854-4f6d-8098-87d377d8d46e" containerID="773a5bcea075046cc5c11a5cff90f7a99182e594c01d385d4cb7ee66e6a5c561" exitCode=0 Jun 02 20:09:48.226995 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:48.226654 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8" event={"ID":"0fc4b24e-5854-4f6d-8098-87d377d8d46e","Type":"ContainerDied","Data":"773a5bcea075046cc5c11a5cff90f7a99182e594c01d385d4cb7ee66e6a5c561"} Jun 02 20:09:48.226995 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:48.226675 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8" event={"ID":"0fc4b24e-5854-4f6d-8098-87d377d8d46e","Type":"ContainerStarted","Data":"20b2382cc0cfaa7ebd455e75e980b353e9740d908f3438518e70570a69c4a38b"} Jun 02 20:09:49.231011 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:49.230976 2562 generic.go:358] "Generic (PLEG): container finished" podID="0fc4b24e-5854-4f6d-8098-87d377d8d46e" containerID="06d5c72c7d7a5579b2ccea39113f5e81f9191e87817ce4fe2fc28c62f6e93b0a" exitCode=0 Jun 02 20:09:49.231406 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:49.231067 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8" event={"ID":"0fc4b24e-5854-4f6d-8098-87d377d8d46e","Type":"ContainerDied","Data":"06d5c72c7d7a5579b2ccea39113f5e81f9191e87817ce4fe2fc28c62f6e93b0a"} Jun 02 20:09:50.235283 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:50.235244 2562 generic.go:358] "Generic (PLEG): container finished" podID="0fc4b24e-5854-4f6d-8098-87d377d8d46e" containerID="d6359fef25d610f9389054135861bdcdbda5a5d58f26d9be4c22ceb7f352f5a3" exitCode=0 Jun 02 20:09:50.235695 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:50.235330 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8" event={"ID":"0fc4b24e-5854-4f6d-8098-87d377d8d46e","Type":"ContainerDied","Data":"d6359fef25d610f9389054135861bdcdbda5a5d58f26d9be4c22ceb7f352f5a3"} Jun 02 20:09:51.365073 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:51.365050 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8" Jun 02 20:09:51.489534 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:51.489432 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6ntw\" (UniqueName: \"kubernetes.io/projected/0fc4b24e-5854-4f6d-8098-87d377d8d46e-kube-api-access-c6ntw\") pod \"0fc4b24e-5854-4f6d-8098-87d377d8d46e\" (UID: \"0fc4b24e-5854-4f6d-8098-87d377d8d46e\") " Jun 02 20:09:51.489534 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:51.489482 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fc4b24e-5854-4f6d-8098-87d377d8d46e-bundle\") pod \"0fc4b24e-5854-4f6d-8098-87d377d8d46e\" (UID: \"0fc4b24e-5854-4f6d-8098-87d377d8d46e\") " Jun 02 20:09:51.489534 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:51.489501 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fc4b24e-5854-4f6d-8098-87d377d8d46e-util\") pod \"0fc4b24e-5854-4f6d-8098-87d377d8d46e\" (UID: \"0fc4b24e-5854-4f6d-8098-87d377d8d46e\") " Jun 02 20:09:51.490194 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:51.490168 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fc4b24e-5854-4f6d-8098-87d377d8d46e-bundle" (OuterVolumeSpecName: "bundle") pod "0fc4b24e-5854-4f6d-8098-87d377d8d46e" (UID: "0fc4b24e-5854-4f6d-8098-87d377d8d46e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:09:51.491706 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:51.491677 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fc4b24e-5854-4f6d-8098-87d377d8d46e-kube-api-access-c6ntw" (OuterVolumeSpecName: "kube-api-access-c6ntw") pod "0fc4b24e-5854-4f6d-8098-87d377d8d46e" (UID: "0fc4b24e-5854-4f6d-8098-87d377d8d46e"). InnerVolumeSpecName "kube-api-access-c6ntw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:09:51.494975 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:51.494949 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fc4b24e-5854-4f6d-8098-87d377d8d46e-util" (OuterVolumeSpecName: "util") pod "0fc4b24e-5854-4f6d-8098-87d377d8d46e" (UID: "0fc4b24e-5854-4f6d-8098-87d377d8d46e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:09:51.590489 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:51.590425 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6ntw\" (UniqueName: \"kubernetes.io/projected/0fc4b24e-5854-4f6d-8098-87d377d8d46e-kube-api-access-c6ntw\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:09:51.590489 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:51.590485 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fc4b24e-5854-4f6d-8098-87d377d8d46e-bundle\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:09:51.590670 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:51.590499 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fc4b24e-5854-4f6d-8098-87d377d8d46e-util\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:09:52.242499 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:52.242445 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8" event={"ID":"0fc4b24e-5854-4f6d-8098-87d377d8d46e","Type":"ContainerDied","Data":"20b2382cc0cfaa7ebd455e75e980b353e9740d908f3438518e70570a69c4a38b"} Jun 02 20:09:52.242499 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:52.242499 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20b2382cc0cfaa7ebd455e75e980b353e9740d908f3438518e70570a69c4a38b" Jun 02 20:09:52.242499 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:09:52.242452 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbfbl8" Jun 02 20:10:04.052503 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.052453 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7"] Jun 02 20:10:04.053052 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.052797 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fc4b24e-5854-4f6d-8098-87d377d8d46e" containerName="pull" Jun 02 20:10:04.053052 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.052815 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fc4b24e-5854-4f6d-8098-87d377d8d46e" containerName="pull" Jun 02 20:10:04.053052 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.052826 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fc4b24e-5854-4f6d-8098-87d377d8d46e" containerName="extract" Jun 02 20:10:04.053052 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.052833 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fc4b24e-5854-4f6d-8098-87d377d8d46e" containerName="extract" Jun 02 20:10:04.053052 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.052847 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fc4b24e-5854-4f6d-8098-87d377d8d46e" containerName="util" Jun 02 20:10:04.053052 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.052855 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fc4b24e-5854-4f6d-8098-87d377d8d46e" containerName="util" Jun 02 20:10:04.053052 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.052927 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="0fc4b24e-5854-4f6d-8098-87d377d8d46e" containerName="extract" Jun 02 20:10:04.058448 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.058422 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:04.061925 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.061895 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 20:10:04.065039 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.065016 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 20:10:04.065136 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.065072 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 20:10:04.065136 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.065102 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-998mr\"" Jun 02 20:10:04.067751 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.067733 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 20:10:04.080188 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.080162 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq2sc\" (UniqueName: \"kubernetes.io/projected/c541706b-3e22-4792-8c03-8795c65e2abd-kube-api-access-tq2sc\") pod \"opendatahub-operator-controller-manager-58b87b6c86-69ln7\" (UID: \"c541706b-3e22-4792-8c03-8795c65e2abd\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:04.080287 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.080210 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c541706b-3e22-4792-8c03-8795c65e2abd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58b87b6c86-69ln7\" (UID: \"c541706b-3e22-4792-8c03-8795c65e2abd\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:04.080287 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.080252 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c541706b-3e22-4792-8c03-8795c65e2abd-webhook-cert\") pod \"opendatahub-operator-controller-manager-58b87b6c86-69ln7\" (UID: \"c541706b-3e22-4792-8c03-8795c65e2abd\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:04.080397 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.080289 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c541706b-3e22-4792-8c03-8795c65e2abd-tmp\") pod \"opendatahub-operator-controller-manager-58b87b6c86-69ln7\" (UID: \"c541706b-3e22-4792-8c03-8795c65e2abd\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:04.080397 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.080350 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c541706b-3e22-4792-8c03-8795c65e2abd-manifests\") pod \"opendatahub-operator-controller-manager-58b87b6c86-69ln7\" (UID: \"c541706b-3e22-4792-8c03-8795c65e2abd\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:04.092795 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.092767 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7"] Jun 02 20:10:04.180782 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.180745 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c541706b-3e22-4792-8c03-8795c65e2abd-manifests\") pod \"opendatahub-operator-controller-manager-58b87b6c86-69ln7\" (UID: \"c541706b-3e22-4792-8c03-8795c65e2abd\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:04.180945 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.180811 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tq2sc\" (UniqueName: \"kubernetes.io/projected/c541706b-3e22-4792-8c03-8795c65e2abd-kube-api-access-tq2sc\") pod \"opendatahub-operator-controller-manager-58b87b6c86-69ln7\" (UID: \"c541706b-3e22-4792-8c03-8795c65e2abd\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:04.180945 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.180844 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c541706b-3e22-4792-8c03-8795c65e2abd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58b87b6c86-69ln7\" (UID: \"c541706b-3e22-4792-8c03-8795c65e2abd\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:04.180945 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.180864 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c541706b-3e22-4792-8c03-8795c65e2abd-webhook-cert\") pod \"opendatahub-operator-controller-manager-58b87b6c86-69ln7\" (UID: \"c541706b-3e22-4792-8c03-8795c65e2abd\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:04.180945 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.180882 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c541706b-3e22-4792-8c03-8795c65e2abd-tmp\") pod \"opendatahub-operator-controller-manager-58b87b6c86-69ln7\" (UID: \"c541706b-3e22-4792-8c03-8795c65e2abd\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:04.181202 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.181179 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c541706b-3e22-4792-8c03-8795c65e2abd-manifests\") pod \"opendatahub-operator-controller-manager-58b87b6c86-69ln7\" (UID: \"c541706b-3e22-4792-8c03-8795c65e2abd\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:04.183229 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.183200 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c541706b-3e22-4792-8c03-8795c65e2abd-tmp\") pod \"opendatahub-operator-controller-manager-58b87b6c86-69ln7\" (UID: \"c541706b-3e22-4792-8c03-8795c65e2abd\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:04.183363 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.183306 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c541706b-3e22-4792-8c03-8795c65e2abd-webhook-cert\") pod \"opendatahub-operator-controller-manager-58b87b6c86-69ln7\" (UID: \"c541706b-3e22-4792-8c03-8795c65e2abd\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:04.183555 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.183537 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c541706b-3e22-4792-8c03-8795c65e2abd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58b87b6c86-69ln7\" (UID: \"c541706b-3e22-4792-8c03-8795c65e2abd\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:04.196965 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.196938 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq2sc\" (UniqueName: \"kubernetes.io/projected/c541706b-3e22-4792-8c03-8795c65e2abd-kube-api-access-tq2sc\") pod \"opendatahub-operator-controller-manager-58b87b6c86-69ln7\" (UID: \"c541706b-3e22-4792-8c03-8795c65e2abd\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:04.368246 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.368216 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:04.507795 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:04.507762 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7"] Jun 02 20:10:04.511951 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:10:04.511924 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc541706b_3e22_4792_8c03_8795c65e2abd.slice/crio-804593a64fba7d4ca63f7ffe8be8dea24434c2f3632157ffdd948a02c796cd51 WatchSource:0}: Error finding container 804593a64fba7d4ca63f7ffe8be8dea24434c2f3632157ffdd948a02c796cd51: Status 404 returned error can't find the container with id 804593a64fba7d4ca63f7ffe8be8dea24434c2f3632157ffdd948a02c796cd51 Jun 02 20:10:05.279767 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:05.279719 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" event={"ID":"c541706b-3e22-4792-8c03-8795c65e2abd","Type":"ContainerStarted","Data":"804593a64fba7d4ca63f7ffe8be8dea24434c2f3632157ffdd948a02c796cd51"} Jun 02 20:10:08.292130 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:08.292029 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" event={"ID":"c541706b-3e22-4792-8c03-8795c65e2abd","Type":"ContainerStarted","Data":"955ad0d10f3cb246ef4706a6e0fe5ba20fb90886aecf3aeef173605c16cc31f9"} Jun 02 20:10:09.297540 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:09.297437 2562 generic.go:358] "Generic (PLEG): container finished" podID="c541706b-3e22-4792-8c03-8795c65e2abd" containerID="955ad0d10f3cb246ef4706a6e0fe5ba20fb90886aecf3aeef173605c16cc31f9" exitCode=0 Jun 02 20:10:09.297912 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:09.297531 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" event={"ID":"c541706b-3e22-4792-8c03-8795c65e2abd","Type":"ContainerDied","Data":"955ad0d10f3cb246ef4706a6e0fe5ba20fb90886aecf3aeef173605c16cc31f9"} Jun 02 20:10:10.301821 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:10.301778 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" event={"ID":"c541706b-3e22-4792-8c03-8795c65e2abd","Type":"ContainerStarted","Data":"89fdfe2a35f44f87ba92a1cae74515794f020b82a7d4c2b67089690cb1e8276f"} Jun 02 20:10:10.302300 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:10.301940 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:10.327167 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:10.327114 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" podStartSLOduration=1.141779019 podStartE2EDuration="6.327099322s" podCreationTimestamp="2026-06-02 20:10:04 +0000 UTC" firstStartedPulling="2026-06-02 20:10:04.513597378 +0000 UTC m=+499.358883324" lastFinishedPulling="2026-06-02 20:10:09.698917679 +0000 UTC m=+504.544203627" observedRunningTime="2026-06-02 20:10:10.325567707 +0000 UTC m=+505.170853675" watchObservedRunningTime="2026-06-02 20:10:10.327099322 +0000 UTC m=+505.172385287" Jun 02 20:10:21.306596 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:21.306563 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-69ln7" Jun 02 20:10:24.311851 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.311810 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-78d7545c57-xt7fw"] Jun 02 20:10:24.316579 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.316555 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78d7545c57-xt7fw" Jun 02 20:10:24.319319 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.319294 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 20:10:24.319453 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.319411 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 20:10:24.320093 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.320076 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 20:10:24.320190 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.320102 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 20:10:24.334935 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.334904 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78d7545c57-xt7fw"] Jun 02 20:10:24.407593 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.407549 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89b79022-e3c5-4382-a921-8b05591e084b-tmp\") pod \"kube-auth-proxy-78d7545c57-xt7fw\" (UID: \"89b79022-e3c5-4382-a921-8b05591e084b\") " pod="openshift-ingress/kube-auth-proxy-78d7545c57-xt7fw" Jun 02 20:10:24.407789 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.407614 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89b79022-e3c5-4382-a921-8b05591e084b-tls-certs\") pod \"kube-auth-proxy-78d7545c57-xt7fw\" (UID: \"89b79022-e3c5-4382-a921-8b05591e084b\") " pod="openshift-ingress/kube-auth-proxy-78d7545c57-xt7fw" Jun 02 20:10:24.407789 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.407651 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2j7c\" (UniqueName: \"kubernetes.io/projected/89b79022-e3c5-4382-a921-8b05591e084b-kube-api-access-b2j7c\") pod \"kube-auth-proxy-78d7545c57-xt7fw\" (UID: \"89b79022-e3c5-4382-a921-8b05591e084b\") " pod="openshift-ingress/kube-auth-proxy-78d7545c57-xt7fw" Jun 02 20:10:24.500473 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.500432 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-fm5jp"] Jun 02 20:10:24.503175 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.503159 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-fm5jp" Jun 02 20:10:24.505650 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.505627 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 02 20:10:24.505764 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.505695 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8bn44\"" Jun 02 20:10:24.508524 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.508495 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktt5x\" (UniqueName: \"kubernetes.io/projected/3c9dbfe0-5c73-4ffe-a4ff-707937c4346d-kube-api-access-ktt5x\") pod \"odh-model-controller-76588b95-fm5jp\" (UID: \"3c9dbfe0-5c73-4ffe-a4ff-707937c4346d\") " pod="opendatahub/odh-model-controller-76588b95-fm5jp" Jun 02 20:10:24.508615 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.508604 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89b79022-e3c5-4382-a921-8b05591e084b-tmp\") pod \"kube-auth-proxy-78d7545c57-xt7fw\" (UID: \"89b79022-e3c5-4382-a921-8b05591e084b\") " pod="openshift-ingress/kube-auth-proxy-78d7545c57-xt7fw" Jun 02 20:10:24.508652 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.508640 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89b79022-e3c5-4382-a921-8b05591e084b-tls-certs\") pod \"kube-auth-proxy-78d7545c57-xt7fw\" (UID: \"89b79022-e3c5-4382-a921-8b05591e084b\") " pod="openshift-ingress/kube-auth-proxy-78d7545c57-xt7fw" Jun 02 20:10:24.508686 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.508664 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2j7c\" (UniqueName: \"kubernetes.io/projected/89b79022-e3c5-4382-a921-8b05591e084b-kube-api-access-b2j7c\") pod \"kube-auth-proxy-78d7545c57-xt7fw\" (UID: \"89b79022-e3c5-4382-a921-8b05591e084b\") " pod="openshift-ingress/kube-auth-proxy-78d7545c57-xt7fw" Jun 02 20:10:24.508686 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.508682 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c9dbfe0-5c73-4ffe-a4ff-707937c4346d-cert\") pod \"odh-model-controller-76588b95-fm5jp\" (UID: \"3c9dbfe0-5c73-4ffe-a4ff-707937c4346d\") " pod="opendatahub/odh-model-controller-76588b95-fm5jp" Jun 02 20:10:24.511059 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.511032 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89b79022-e3c5-4382-a921-8b05591e084b-tmp\") pod \"kube-auth-proxy-78d7545c57-xt7fw\" (UID: \"89b79022-e3c5-4382-a921-8b05591e084b\") " pod="openshift-ingress/kube-auth-proxy-78d7545c57-xt7fw" Jun 02 20:10:24.511285 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.511268 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89b79022-e3c5-4382-a921-8b05591e084b-tls-certs\") pod \"kube-auth-proxy-78d7545c57-xt7fw\" (UID: \"89b79022-e3c5-4382-a921-8b05591e084b\") " pod="openshift-ingress/kube-auth-proxy-78d7545c57-xt7fw" Jun 02 20:10:24.516403 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.516380 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-fm5jp"] Jun 02 20:10:24.522984 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.522930 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2j7c\" (UniqueName: \"kubernetes.io/projected/89b79022-e3c5-4382-a921-8b05591e084b-kube-api-access-b2j7c\") pod \"kube-auth-proxy-78d7545c57-xt7fw\" (UID: \"89b79022-e3c5-4382-a921-8b05591e084b\") " pod="openshift-ingress/kube-auth-proxy-78d7545c57-xt7fw" Jun 02 20:10:24.609099 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.609012 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c9dbfe0-5c73-4ffe-a4ff-707937c4346d-cert\") pod \"odh-model-controller-76588b95-fm5jp\" (UID: \"3c9dbfe0-5c73-4ffe-a4ff-707937c4346d\") " pod="opendatahub/odh-model-controller-76588b95-fm5jp" Jun 02 20:10:24.609099 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.609051 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ktt5x\" (UniqueName: \"kubernetes.io/projected/3c9dbfe0-5c73-4ffe-a4ff-707937c4346d-kube-api-access-ktt5x\") pod \"odh-model-controller-76588b95-fm5jp\" (UID: \"3c9dbfe0-5c73-4ffe-a4ff-707937c4346d\") " pod="opendatahub/odh-model-controller-76588b95-fm5jp" Jun 02 20:10:24.609306 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:10:24.609109 2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 02 20:10:24.609306 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:10:24.609187 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c9dbfe0-5c73-4ffe-a4ff-707937c4346d-cert podName:3c9dbfe0-5c73-4ffe-a4ff-707937c4346d nodeName:}" failed. No retries permitted until 2026-06-02 20:10:25.109166023 +0000 UTC m=+519.954451974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3c9dbfe0-5c73-4ffe-a4ff-707937c4346d-cert") pod "odh-model-controller-76588b95-fm5jp" (UID: "3c9dbfe0-5c73-4ffe-a4ff-707937c4346d") : secret "odh-model-controller-webhook-cert" not found Jun 02 20:10:24.626359 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.626329 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78d7545c57-xt7fw" Jun 02 20:10:24.629685 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.629659 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktt5x\" (UniqueName: \"kubernetes.io/projected/3c9dbfe0-5c73-4ffe-a4ff-707937c4346d-kube-api-access-ktt5x\") pod \"odh-model-controller-76588b95-fm5jp\" (UID: \"3c9dbfe0-5c73-4ffe-a4ff-707937c4346d\") " pod="opendatahub/odh-model-controller-76588b95-fm5jp" Jun 02 20:10:24.768055 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:24.768017 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78d7545c57-xt7fw"] Jun 02 20:10:24.771218 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:10:24.771173 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89b79022_e3c5_4382_a921_8b05591e084b.slice/crio-bd879648a5cc514ab4da8c39808636a53433144b0fdd7484d072dc474157fbdb WatchSource:0}: Error finding container bd879648a5cc514ab4da8c39808636a53433144b0fdd7484d072dc474157fbdb: Status 404 returned error can't find the container with id bd879648a5cc514ab4da8c39808636a53433144b0fdd7484d072dc474157fbdb Jun 02 20:10:25.111452 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:25.111417 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c9dbfe0-5c73-4ffe-a4ff-707937c4346d-cert\") pod \"odh-model-controller-76588b95-fm5jp\" (UID: \"3c9dbfe0-5c73-4ffe-a4ff-707937c4346d\") " pod="opendatahub/odh-model-controller-76588b95-fm5jp" Jun 02 20:10:25.111619 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:10:25.111581 2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 02 20:10:25.111660 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:10:25.111644 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c9dbfe0-5c73-4ffe-a4ff-707937c4346d-cert podName:3c9dbfe0-5c73-4ffe-a4ff-707937c4346d nodeName:}" failed. No retries permitted until 2026-06-02 20:10:26.111626537 +0000 UTC m=+520.956912493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3c9dbfe0-5c73-4ffe-a4ff-707937c4346d-cert") pod "odh-model-controller-76588b95-fm5jp" (UID: "3c9dbfe0-5c73-4ffe-a4ff-707937c4346d") : secret "odh-model-controller-webhook-cert" not found Jun 02 20:10:25.351234 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:25.351148 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78d7545c57-xt7fw" event={"ID":"89b79022-e3c5-4382-a921-8b05591e084b","Type":"ContainerStarted","Data":"bd879648a5cc514ab4da8c39808636a53433144b0fdd7484d072dc474157fbdb"} Jun 02 20:10:25.402289 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:25.402256 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-2jxzn"] Jun 02 20:10:25.404798 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:25.404780 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-2jxzn" Jun 02 20:10:25.406931 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:25.406909 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 02 20:10:25.414056 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:25.414032 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d561207b-1a89-4ac5-8ca6-ad0baa05d9bd-tls-certs\") pod \"model-serving-api-6577596cd5-2jxzn\" (UID: \"d561207b-1a89-4ac5-8ca6-ad0baa05d9bd\") " pod="opendatahub/model-serving-api-6577596cd5-2jxzn" Jun 02 20:10:25.414138 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:25.414090 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncvss\" (UniqueName: \"kubernetes.io/projected/d561207b-1a89-4ac5-8ca6-ad0baa05d9bd-kube-api-access-ncvss\") pod \"model-serving-api-6577596cd5-2jxzn\" (UID: \"d561207b-1a89-4ac5-8ca6-ad0baa05d9bd\") " pod="opendatahub/model-serving-api-6577596cd5-2jxzn" Jun 02 20:10:25.417701 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:25.417682 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-2jxzn"] Jun 02 20:10:25.515660 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:25.515622 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d561207b-1a89-4ac5-8ca6-ad0baa05d9bd-tls-certs\") pod \"model-serving-api-6577596cd5-2jxzn\" (UID: \"d561207b-1a89-4ac5-8ca6-ad0baa05d9bd\") " pod="opendatahub/model-serving-api-6577596cd5-2jxzn" Jun 02 20:10:25.515886 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:25.515714 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ncvss\" (UniqueName: \"kubernetes.io/projected/d561207b-1a89-4ac5-8ca6-ad0baa05d9bd-kube-api-access-ncvss\") pod \"model-serving-api-6577596cd5-2jxzn\" (UID: \"d561207b-1a89-4ac5-8ca6-ad0baa05d9bd\") " pod="opendatahub/model-serving-api-6577596cd5-2jxzn" Jun 02 20:10:25.515886 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:10:25.515819 2562 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 02 20:10:25.516099 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:10:25.515898 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d561207b-1a89-4ac5-8ca6-ad0baa05d9bd-tls-certs podName:d561207b-1a89-4ac5-8ca6-ad0baa05d9bd nodeName:}" failed. No retries permitted until 2026-06-02 20:10:26.015878088 +0000 UTC m=+520.861164047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d561207b-1a89-4ac5-8ca6-ad0baa05d9bd-tls-certs") pod "model-serving-api-6577596cd5-2jxzn" (UID: "d561207b-1a89-4ac5-8ca6-ad0baa05d9bd") : secret "model-serving-api-tls" not found Jun 02 20:10:25.532815 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:25.532753 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncvss\" (UniqueName: \"kubernetes.io/projected/d561207b-1a89-4ac5-8ca6-ad0baa05d9bd-kube-api-access-ncvss\") pod \"model-serving-api-6577596cd5-2jxzn\" (UID: \"d561207b-1a89-4ac5-8ca6-ad0baa05d9bd\") " pod="opendatahub/model-serving-api-6577596cd5-2jxzn" Jun 02 20:10:26.019429 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.019373 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d561207b-1a89-4ac5-8ca6-ad0baa05d9bd-tls-certs\") pod \"model-serving-api-6577596cd5-2jxzn\" (UID: \"d561207b-1a89-4ac5-8ca6-ad0baa05d9bd\") " pod="opendatahub/model-serving-api-6577596cd5-2jxzn" Jun 02 20:10:26.031651 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.031614 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d561207b-1a89-4ac5-8ca6-ad0baa05d9bd-tls-certs\") pod \"model-serving-api-6577596cd5-2jxzn\" (UID: \"d561207b-1a89-4ac5-8ca6-ad0baa05d9bd\") " pod="opendatahub/model-serving-api-6577596cd5-2jxzn" Jun 02 20:10:26.120180 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.120130 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c9dbfe0-5c73-4ffe-a4ff-707937c4346d-cert\") pod \"odh-model-controller-76588b95-fm5jp\" (UID: \"3c9dbfe0-5c73-4ffe-a4ff-707937c4346d\") " pod="opendatahub/odh-model-controller-76588b95-fm5jp" Jun 02 20:10:26.121731 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.121700 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh"] Jun 02 20:10:26.123611 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.123549 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c9dbfe0-5c73-4ffe-a4ff-707937c4346d-cert\") pod \"odh-model-controller-76588b95-fm5jp\" (UID: \"3c9dbfe0-5c73-4ffe-a4ff-707937c4346d\") " pod="opendatahub/odh-model-controller-76588b95-fm5jp" Jun 02 20:10:26.124783 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.124762 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh" Jun 02 20:10:26.127741 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.127707 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 20:10:26.127741 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.127722 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 20:10:26.127997 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.127977 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t9r55\"" Jun 02 20:10:26.140190 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.138005 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh"] Jun 02 20:10:26.220670 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.220633 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26c30703-7c8e-401d-9e37-5a2af8b1ea7f-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh\" (UID: \"26c30703-7c8e-401d-9e37-5a2af8b1ea7f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh" Jun 02 20:10:26.220835 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.220726 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26c30703-7c8e-401d-9e37-5a2af8b1ea7f-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh\" (UID: \"26c30703-7c8e-401d-9e37-5a2af8b1ea7f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh" Jun 02 20:10:26.220835 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.220763 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbl5k\" (UniqueName: \"kubernetes.io/projected/26c30703-7c8e-401d-9e37-5a2af8b1ea7f-kube-api-access-qbl5k\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh\" (UID: \"26c30703-7c8e-401d-9e37-5a2af8b1ea7f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh" Jun 02 20:10:26.313367 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.313329 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-fm5jp" Jun 02 20:10:26.315070 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.315051 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-2jxzn" Jun 02 20:10:26.321983 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.321961 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26c30703-7c8e-401d-9e37-5a2af8b1ea7f-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh\" (UID: \"26c30703-7c8e-401d-9e37-5a2af8b1ea7f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh" Jun 02 20:10:26.322096 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.322025 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26c30703-7c8e-401d-9e37-5a2af8b1ea7f-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh\" (UID: \"26c30703-7c8e-401d-9e37-5a2af8b1ea7f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh" Jun 02 20:10:26.322096 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.322061 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbl5k\" (UniqueName: \"kubernetes.io/projected/26c30703-7c8e-401d-9e37-5a2af8b1ea7f-kube-api-access-qbl5k\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh\" (UID: \"26c30703-7c8e-401d-9e37-5a2af8b1ea7f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh" Jun 02 20:10:26.322392 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.322373 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26c30703-7c8e-401d-9e37-5a2af8b1ea7f-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh\" (UID: \"26c30703-7c8e-401d-9e37-5a2af8b1ea7f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh" Jun 02 20:10:26.322485 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.322433 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26c30703-7c8e-401d-9e37-5a2af8b1ea7f-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh\" (UID: \"26c30703-7c8e-401d-9e37-5a2af8b1ea7f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh" Jun 02 20:10:26.331731 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.331710 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbl5k\" (UniqueName: \"kubernetes.io/projected/26c30703-7c8e-401d-9e37-5a2af8b1ea7f-kube-api-access-qbl5k\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh\" (UID: \"26c30703-7c8e-401d-9e37-5a2af8b1ea7f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh" Jun 02 20:10:26.445384 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:26.445345 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh" Jun 02 20:10:27.108047 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:27.108022 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-fm5jp"] Jun 02 20:10:27.110563 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:10:27.110530 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9dbfe0_5c73_4ffe_a4ff_707937c4346d.slice/crio-51bf3e5e5a7057dd0ba4847295aa030ce4052451ec539d993856e8f2ba56a8a8 WatchSource:0}: Error finding container 51bf3e5e5a7057dd0ba4847295aa030ce4052451ec539d993856e8f2ba56a8a8: Status 404 returned error can't find the container with id 51bf3e5e5a7057dd0ba4847295aa030ce4052451ec539d993856e8f2ba56a8a8 Jun 02 20:10:27.336241 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:27.335956 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh"] Jun 02 20:10:27.338872 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:10:27.338838 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c30703_7c8e_401d_9e37_5a2af8b1ea7f.slice/crio-d3f81c6dfc08871fe0edbb36d511debb531791a4409dfbbe25652bcafb834a17 WatchSource:0}: Error finding container d3f81c6dfc08871fe0edbb36d511debb531791a4409dfbbe25652bcafb834a17: Status 404 returned error can't find the container with id d3f81c6dfc08871fe0edbb36d511debb531791a4409dfbbe25652bcafb834a17 Jun 02 20:10:27.343750 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:27.343658 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-2jxzn"] Jun 02 20:10:27.346266 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:10:27.346235 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd561207b_1a89_4ac5_8ca6_ad0baa05d9bd.slice/crio-45a1f6e169fdf381490ed508d603fcf62f8ba697fb2e459ebca450dc253ffaea WatchSource:0}: Error finding container 45a1f6e169fdf381490ed508d603fcf62f8ba697fb2e459ebca450dc253ffaea: Status 404 returned error can't find the container with id 45a1f6e169fdf381490ed508d603fcf62f8ba697fb2e459ebca450dc253ffaea Jun 02 20:10:27.360516 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:27.360484 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh" event={"ID":"26c30703-7c8e-401d-9e37-5a2af8b1ea7f","Type":"ContainerStarted","Data":"d3f81c6dfc08871fe0edbb36d511debb531791a4409dfbbe25652bcafb834a17"} Jun 02 20:10:27.361784 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:27.361751 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-2jxzn" event={"ID":"d561207b-1a89-4ac5-8ca6-ad0baa05d9bd","Type":"ContainerStarted","Data":"45a1f6e169fdf381490ed508d603fcf62f8ba697fb2e459ebca450dc253ffaea"} Jun 02 20:10:27.362849 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:27.362830 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-fm5jp" event={"ID":"3c9dbfe0-5c73-4ffe-a4ff-707937c4346d","Type":"ContainerStarted","Data":"51bf3e5e5a7057dd0ba4847295aa030ce4052451ec539d993856e8f2ba56a8a8"} Jun 02 20:10:28.374068 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:28.373961 2562 generic.go:358] "Generic (PLEG): container finished" podID="26c30703-7c8e-401d-9e37-5a2af8b1ea7f" containerID="7e48f5709d496303f0948a226e2ab68773f8e8210e44da12aec28cf9b34f72b8" exitCode=0 Jun 02 20:10:28.374068 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:28.374027 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh" event={"ID":"26c30703-7c8e-401d-9e37-5a2af8b1ea7f","Type":"ContainerDied","Data":"7e48f5709d496303f0948a226e2ab68773f8e8210e44da12aec28cf9b34f72b8"} Jun 02 20:10:29.378816 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:29.378778 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78d7545c57-xt7fw" event={"ID":"89b79022-e3c5-4382-a921-8b05591e084b","Type":"ContainerStarted","Data":"1fcc55e9f483f36a14475495823d0091e9deaaea8b6241ad92540aa07be11c29"} Jun 02 20:10:29.397901 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:29.397832 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-78d7545c57-xt7fw" podStartSLOduration=1.7409453049999999 podStartE2EDuration="5.397813712s" podCreationTimestamp="2026-06-02 20:10:24 +0000 UTC" firstStartedPulling="2026-06-02 20:10:24.773027637 +0000 UTC m=+519.618313586" lastFinishedPulling="2026-06-02 20:10:28.429896032 +0000 UTC m=+523.275181993" observedRunningTime="2026-06-02 20:10:29.397033556 +0000 UTC m=+524.242319538" watchObservedRunningTime="2026-06-02 20:10:29.397813712 +0000 UTC m=+524.243099683" Jun 02 20:10:31.388175 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:31.388139 2562 generic.go:358] "Generic (PLEG): container finished" podID="26c30703-7c8e-401d-9e37-5a2af8b1ea7f" containerID="04c4c659d5a9b47d72eab87a25dab4fe7efc82e9252d6f62c5973b4f178ceeb2" exitCode=0 Jun 02 20:10:31.388659 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:31.388237 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh" event={"ID":"26c30703-7c8e-401d-9e37-5a2af8b1ea7f","Type":"ContainerDied","Data":"04c4c659d5a9b47d72eab87a25dab4fe7efc82e9252d6f62c5973b4f178ceeb2"} Jun 02 20:10:31.389686 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:31.389651 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-2jxzn" event={"ID":"d561207b-1a89-4ac5-8ca6-ad0baa05d9bd","Type":"ContainerStarted","Data":"6188efa3753acdb8b6ae77afa7bd24324bd7e5c3218c206f1b4cfd02ee65e531"} Jun 02 20:10:31.389798 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:31.389770 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-2jxzn" Jun 02 20:10:31.391022 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:31.391001 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-fm5jp" event={"ID":"3c9dbfe0-5c73-4ffe-a4ff-707937c4346d","Type":"ContainerStarted","Data":"85c1e45aea69d0d510ab3bf888f62166d9c7fe825b30d18268510fe4f92dd4a3"} Jun 02 20:10:31.391922 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:31.391901 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-fm5jp" Jun 02 20:10:31.447131 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:31.447087 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-fm5jp" podStartSLOduration=4.026356293 podStartE2EDuration="7.44707337s" podCreationTimestamp="2026-06-02 20:10:24 +0000 UTC" firstStartedPulling="2026-06-02 20:10:27.112151198 +0000 UTC m=+521.957437148" lastFinishedPulling="2026-06-02 20:10:30.53286828 +0000 UTC m=+525.378154225" observedRunningTime="2026-06-02 20:10:31.446366118 +0000 UTC m=+526.291652088" watchObservedRunningTime="2026-06-02 20:10:31.44707337 +0000 UTC m=+526.292359337" Jun 02 20:10:31.485511 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:31.485435 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-2jxzn" podStartSLOduration=3.299489708 podStartE2EDuration="6.485420554s" podCreationTimestamp="2026-06-02 20:10:25 +0000 UTC" firstStartedPulling="2026-06-02 20:10:27.34843417 +0000 UTC m=+522.193720122" lastFinishedPulling="2026-06-02 20:10:30.53436502 +0000 UTC m=+525.379650968" observedRunningTime="2026-06-02 20:10:31.483636772 +0000 UTC m=+526.328922741" watchObservedRunningTime="2026-06-02 20:10:31.485420554 +0000 UTC m=+526.330706545" Jun 02 20:10:32.395324 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:32.395288 2562 generic.go:358] "Generic (PLEG): container finished" podID="26c30703-7c8e-401d-9e37-5a2af8b1ea7f" containerID="a6b2bdf227fc26308f11721110772f0cf58bd5e849708ffd567a553ca594284d" exitCode=0 Jun 02 20:10:32.395782 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:32.395370 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh" event={"ID":"26c30703-7c8e-401d-9e37-5a2af8b1ea7f","Type":"ContainerDied","Data":"a6b2bdf227fc26308f11721110772f0cf58bd5e849708ffd567a553ca594284d"} Jun 02 20:10:33.531721 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:33.531694 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh" Jun 02 20:10:33.590080 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:33.590040 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26c30703-7c8e-401d-9e37-5a2af8b1ea7f-bundle\") pod \"26c30703-7c8e-401d-9e37-5a2af8b1ea7f\" (UID: \"26c30703-7c8e-401d-9e37-5a2af8b1ea7f\") " Jun 02 20:10:33.590243 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:33.590091 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26c30703-7c8e-401d-9e37-5a2af8b1ea7f-util\") pod \"26c30703-7c8e-401d-9e37-5a2af8b1ea7f\" (UID: \"26c30703-7c8e-401d-9e37-5a2af8b1ea7f\") " Jun 02 20:10:33.590243 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:33.590155 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbl5k\" (UniqueName: \"kubernetes.io/projected/26c30703-7c8e-401d-9e37-5a2af8b1ea7f-kube-api-access-qbl5k\") pod \"26c30703-7c8e-401d-9e37-5a2af8b1ea7f\" (UID: \"26c30703-7c8e-401d-9e37-5a2af8b1ea7f\") " Jun 02 20:10:33.591708 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:33.591672 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c30703-7c8e-401d-9e37-5a2af8b1ea7f-bundle" (OuterVolumeSpecName: "bundle") pod "26c30703-7c8e-401d-9e37-5a2af8b1ea7f" (UID: "26c30703-7c8e-401d-9e37-5a2af8b1ea7f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:10:33.593070 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:33.593035 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26c30703-7c8e-401d-9e37-5a2af8b1ea7f-kube-api-access-qbl5k" (OuterVolumeSpecName: "kube-api-access-qbl5k") pod "26c30703-7c8e-401d-9e37-5a2af8b1ea7f" (UID: "26c30703-7c8e-401d-9e37-5a2af8b1ea7f"). InnerVolumeSpecName "kube-api-access-qbl5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:10:33.594970 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:33.594947 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c30703-7c8e-401d-9e37-5a2af8b1ea7f-util" (OuterVolumeSpecName: "util") pod "26c30703-7c8e-401d-9e37-5a2af8b1ea7f" (UID: "26c30703-7c8e-401d-9e37-5a2af8b1ea7f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:10:33.691671 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:33.691591 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26c30703-7c8e-401d-9e37-5a2af8b1ea7f-bundle\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:10:33.691671 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:33.691619 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26c30703-7c8e-401d-9e37-5a2af8b1ea7f-util\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:10:33.691671 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:33.691629 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbl5k\" (UniqueName: \"kubernetes.io/projected/26c30703-7c8e-401d-9e37-5a2af8b1ea7f-kube-api-access-qbl5k\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:10:34.408172 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:34.408130 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh" event={"ID":"26c30703-7c8e-401d-9e37-5a2af8b1ea7f","Type":"ContainerDied","Data":"d3f81c6dfc08871fe0edbb36d511debb531791a4409dfbbe25652bcafb834a17"} Jun 02 20:10:34.408172 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:34.408154 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835rcrgh" Jun 02 20:10:34.408172 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:34.408165 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3f81c6dfc08871fe0edbb36d511debb531791a4409dfbbe25652bcafb834a17" Jun 02 20:10:36.430937 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.430903 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-6bg74"] Jun 02 20:10:36.431373 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.431158 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26c30703-7c8e-401d-9e37-5a2af8b1ea7f" containerName="util" Jun 02 20:10:36.431373 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.431168 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="26c30703-7c8e-401d-9e37-5a2af8b1ea7f" containerName="util" Jun 02 20:10:36.431373 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.431181 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26c30703-7c8e-401d-9e37-5a2af8b1ea7f" containerName="pull" Jun 02 20:10:36.431373 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.431186 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="26c30703-7c8e-401d-9e37-5a2af8b1ea7f" containerName="pull" Jun 02 20:10:36.431373 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.431198 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26c30703-7c8e-401d-9e37-5a2af8b1ea7f" containerName="extract" Jun 02 20:10:36.431373 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.431203 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="26c30703-7c8e-401d-9e37-5a2af8b1ea7f" containerName="extract" Jun 02 20:10:36.431373 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.431258 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="26c30703-7c8e-401d-9e37-5a2af8b1ea7f" containerName="extract" Jun 02 20:10:36.433311 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.433292 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-6bg74" Jun 02 20:10:36.435558 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.435539 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gn6mn\"" Jun 02 20:10:36.435736 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.435715 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 02 20:10:36.447278 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.447246 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-6bg74"] Jun 02 20:10:36.448875 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.448851 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-5thrn"] Jun 02 20:10:36.450852 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.450837 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5thrn" Jun 02 20:10:36.453102 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.453078 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-gl4hc\"" Jun 02 20:10:36.453102 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.453095 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 02 20:10:36.462751 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.462725 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-5thrn"] Jun 02 20:10:36.516391 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.516360 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzclw\" (UniqueName: \"kubernetes.io/projected/d0943bcd-e176-4098-8ee8-4cbdfcb8ff44-kube-api-access-mzclw\") pod \"kserve-controller-manager-7c99ffcdcd-6bg74\" (UID: \"d0943bcd-e176-4098-8ee8-4cbdfcb8ff44\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-6bg74" Jun 02 20:10:36.516391 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.516405 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0943bcd-e176-4098-8ee8-4cbdfcb8ff44-cert\") pod \"kserve-controller-manager-7c99ffcdcd-6bg74\" (UID: \"d0943bcd-e176-4098-8ee8-4cbdfcb8ff44\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-6bg74" Jun 02 20:10:36.516612 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.516423 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24518dce-ca06-4a8e-8830-01fdf956d529-cert\") pod \"llmisvc-controller-manager-c6b9847d7-5thrn\" (UID: \"24518dce-ca06-4a8e-8830-01fdf956d529\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5thrn" Jun 02 20:10:36.516612 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.516560 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2fpm\" (UniqueName: \"kubernetes.io/projected/24518dce-ca06-4a8e-8830-01fdf956d529-kube-api-access-m2fpm\") pod \"llmisvc-controller-manager-c6b9847d7-5thrn\" (UID: \"24518dce-ca06-4a8e-8830-01fdf956d529\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5thrn" Jun 02 20:10:36.617015 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.616981 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mzclw\" (UniqueName: \"kubernetes.io/projected/d0943bcd-e176-4098-8ee8-4cbdfcb8ff44-kube-api-access-mzclw\") pod \"kserve-controller-manager-7c99ffcdcd-6bg74\" (UID: \"d0943bcd-e176-4098-8ee8-4cbdfcb8ff44\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-6bg74" Jun 02 20:10:36.617187 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.617028 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0943bcd-e176-4098-8ee8-4cbdfcb8ff44-cert\") pod \"kserve-controller-manager-7c99ffcdcd-6bg74\" (UID: \"d0943bcd-e176-4098-8ee8-4cbdfcb8ff44\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-6bg74" Jun 02 20:10:36.617187 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.617049 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24518dce-ca06-4a8e-8830-01fdf956d529-cert\") pod \"llmisvc-controller-manager-c6b9847d7-5thrn\" (UID: \"24518dce-ca06-4a8e-8830-01fdf956d529\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5thrn" Jun 02 20:10:36.617187 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.617105 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2fpm\" (UniqueName: \"kubernetes.io/projected/24518dce-ca06-4a8e-8830-01fdf956d529-kube-api-access-m2fpm\") pod \"llmisvc-controller-manager-c6b9847d7-5thrn\" (UID: \"24518dce-ca06-4a8e-8830-01fdf956d529\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5thrn" Jun 02 20:10:36.617307 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:10:36.617213 2562 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 02 20:10:36.617307 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:10:36.617279 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24518dce-ca06-4a8e-8830-01fdf956d529-cert podName:24518dce-ca06-4a8e-8830-01fdf956d529 nodeName:}" failed. No retries permitted until 2026-06-02 20:10:37.117263518 +0000 UTC m=+531.962549463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/24518dce-ca06-4a8e-8830-01fdf956d529-cert") pod "llmisvc-controller-manager-c6b9847d7-5thrn" (UID: "24518dce-ca06-4a8e-8830-01fdf956d529") : secret "llmisvc-webhook-server-cert" not found Jun 02 20:10:36.619631 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.619604 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0943bcd-e176-4098-8ee8-4cbdfcb8ff44-cert\") pod \"kserve-controller-manager-7c99ffcdcd-6bg74\" (UID: \"d0943bcd-e176-4098-8ee8-4cbdfcb8ff44\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-6bg74" Jun 02 20:10:36.635227 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.635198 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzclw\" (UniqueName: \"kubernetes.io/projected/d0943bcd-e176-4098-8ee8-4cbdfcb8ff44-kube-api-access-mzclw\") pod \"kserve-controller-manager-7c99ffcdcd-6bg74\" (UID: \"d0943bcd-e176-4098-8ee8-4cbdfcb8ff44\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-6bg74" Jun 02 20:10:36.635770 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.635746 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2fpm\" (UniqueName: \"kubernetes.io/projected/24518dce-ca06-4a8e-8830-01fdf956d529-kube-api-access-m2fpm\") pod \"llmisvc-controller-manager-c6b9847d7-5thrn\" (UID: \"24518dce-ca06-4a8e-8830-01fdf956d529\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5thrn" Jun 02 20:10:36.742935 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.742856 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-6bg74" Jun 02 20:10:36.875589 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:36.875557 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-6bg74"] Jun 02 20:10:36.880895 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:10:36.880833 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0943bcd_e176_4098_8ee8_4cbdfcb8ff44.slice/crio-99bf1cd9f9a97878e8f9c85315a00ea0d72972bb7ba36842b89febe5f8ec06ef WatchSource:0}: Error finding container 99bf1cd9f9a97878e8f9c85315a00ea0d72972bb7ba36842b89febe5f8ec06ef: Status 404 returned error can't find the container with id 99bf1cd9f9a97878e8f9c85315a00ea0d72972bb7ba36842b89febe5f8ec06ef Jun 02 20:10:37.121210 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:37.121166 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24518dce-ca06-4a8e-8830-01fdf956d529-cert\") pod \"llmisvc-controller-manager-c6b9847d7-5thrn\" (UID: \"24518dce-ca06-4a8e-8830-01fdf956d529\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5thrn" Jun 02 20:10:37.123792 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:37.123759 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24518dce-ca06-4a8e-8830-01fdf956d529-cert\") pod \"llmisvc-controller-manager-c6b9847d7-5thrn\" (UID: \"24518dce-ca06-4a8e-8830-01fdf956d529\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5thrn" Jun 02 20:10:37.362517 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:37.362448 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5thrn" Jun 02 20:10:37.421001 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:37.420958 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-6bg74" event={"ID":"d0943bcd-e176-4098-8ee8-4cbdfcb8ff44","Type":"ContainerStarted","Data":"99bf1cd9f9a97878e8f9c85315a00ea0d72972bb7ba36842b89febe5f8ec06ef"} Jun 02 20:10:37.505528 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:37.505486 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-5thrn"] Jun 02 20:10:37.508446 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:10:37.508416 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod24518dce_ca06_4a8e_8830_01fdf956d529.slice/crio-c6f01361cc0d6ae9e63da9eeb04c418db434c25a4c93d9390011e90cd71f2582 WatchSource:0}: Error finding container c6f01361cc0d6ae9e63da9eeb04c418db434c25a4c93d9390011e90cd71f2582: Status 404 returned error can't find the container with id c6f01361cc0d6ae9e63da9eeb04c418db434c25a4c93d9390011e90cd71f2582 Jun 02 20:10:38.426229 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:38.426191 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5thrn" event={"ID":"24518dce-ca06-4a8e-8830-01fdf956d529","Type":"ContainerStarted","Data":"c6f01361cc0d6ae9e63da9eeb04c418db434c25a4c93d9390011e90cd71f2582"} Jun 02 20:10:40.435426 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:40.435379 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-6bg74" event={"ID":"d0943bcd-e176-4098-8ee8-4cbdfcb8ff44","Type":"ContainerStarted","Data":"10ef207c8e9a778f1f8a25f12e4c4e9616644763b201720a72abf986a8a5d51a"} Jun 02 20:10:40.435910 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:40.435889 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-6bg74" Jun 02 20:10:40.460438 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:40.460329 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-6bg74" podStartSLOduration=1.14537217 podStartE2EDuration="4.460311776s" podCreationTimestamp="2026-06-02 20:10:36 +0000 UTC" firstStartedPulling="2026-06-02 20:10:36.882269297 +0000 UTC m=+531.727555243" lastFinishedPulling="2026-06-02 20:10:40.197208898 +0000 UTC m=+535.042494849" observedRunningTime="2026-06-02 20:10:40.459531649 +0000 UTC m=+535.304817620" watchObservedRunningTime="2026-06-02 20:10:40.460311776 +0000 UTC m=+535.305597744" Jun 02 20:10:41.442981 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:41.442928 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5thrn" event={"ID":"24518dce-ca06-4a8e-8830-01fdf956d529","Type":"ContainerStarted","Data":"a210d29d097caa6110467371c244a4042fe43658973a8b971d377fe0e85d4ba0"} Jun 02 20:10:41.443379 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:41.442990 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5thrn" Jun 02 20:10:41.475288 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:41.475104 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5thrn" podStartSLOduration=2.056983392 podStartE2EDuration="5.475089682s" podCreationTimestamp="2026-06-02 20:10:36 +0000 UTC" firstStartedPulling="2026-06-02 20:10:37.510045373 +0000 UTC m=+532.355331339" lastFinishedPulling="2026-06-02 20:10:40.928151672 +0000 UTC m=+535.773437629" observedRunningTime="2026-06-02 20:10:41.473983886 +0000 UTC m=+536.319269853" watchObservedRunningTime="2026-06-02 20:10:41.475089682 +0000 UTC m=+536.320375649" Jun 02 20:10:42.398027 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:42.397988 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-fm5jp" Jun 02 20:10:42.400012 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:42.399992 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-2jxzn" Jun 02 20:10:42.778796 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:42.778704 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c"] Jun 02 20:10:42.781100 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:42.781077 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c" Jun 02 20:10:42.785029 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:42.785008 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 20:10:42.785151 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:42.785134 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t9r55\"" Jun 02 20:10:42.785218 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:42.785206 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 20:10:42.812441 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:42.812414 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c"] Jun 02 20:10:42.876619 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:42.876581 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7887\" (UniqueName: \"kubernetes.io/projected/968ff13b-d5c8-45d8-a85a-3021a07ca49f-kube-api-access-k7887\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c\" (UID: \"968ff13b-d5c8-45d8-a85a-3021a07ca49f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c" Jun 02 20:10:42.876619 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:42.876630 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/968ff13b-d5c8-45d8-a85a-3021a07ca49f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c\" (UID: \"968ff13b-d5c8-45d8-a85a-3021a07ca49f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c" Jun 02 20:10:42.876833 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:42.876651 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/968ff13b-d5c8-45d8-a85a-3021a07ca49f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c\" (UID: \"968ff13b-d5c8-45d8-a85a-3021a07ca49f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c" Jun 02 20:10:42.977919 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:42.977878 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/968ff13b-d5c8-45d8-a85a-3021a07ca49f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c\" (UID: \"968ff13b-d5c8-45d8-a85a-3021a07ca49f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c" Jun 02 20:10:42.977919 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:42.977923 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/968ff13b-d5c8-45d8-a85a-3021a07ca49f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c\" (UID: \"968ff13b-d5c8-45d8-a85a-3021a07ca49f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c" Jun 02 20:10:42.978123 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:42.977995 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7887\" (UniqueName: \"kubernetes.io/projected/968ff13b-d5c8-45d8-a85a-3021a07ca49f-kube-api-access-k7887\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c\" (UID: \"968ff13b-d5c8-45d8-a85a-3021a07ca49f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c" Jun 02 20:10:42.978286 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:42.978265 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/968ff13b-d5c8-45d8-a85a-3021a07ca49f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c\" (UID: \"968ff13b-d5c8-45d8-a85a-3021a07ca49f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c" Jun 02 20:10:42.978344 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:42.978324 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/968ff13b-d5c8-45d8-a85a-3021a07ca49f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c\" (UID: \"968ff13b-d5c8-45d8-a85a-3021a07ca49f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c" Jun 02 20:10:42.989180 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:42.989153 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7887\" (UniqueName: \"kubernetes.io/projected/968ff13b-d5c8-45d8-a85a-3021a07ca49f-kube-api-access-k7887\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c\" (UID: \"968ff13b-d5c8-45d8-a85a-3021a07ca49f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c" Jun 02 20:10:43.089839 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:43.089802 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c" Jun 02 20:10:43.230154 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:43.230129 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c"] Jun 02 20:10:43.233007 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:10:43.232979 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod968ff13b_d5c8_45d8_a85a_3021a07ca49f.slice/crio-3079603433b1c38adda41a496bda6e6658165588f9174d66625db85b25d3a42f WatchSource:0}: Error finding container 3079603433b1c38adda41a496bda6e6658165588f9174d66625db85b25d3a42f: Status 404 returned error can't find the container with id 3079603433b1c38adda41a496bda6e6658165588f9174d66625db85b25d3a42f Jun 02 20:10:43.451597 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:43.451502 2562 generic.go:358] "Generic (PLEG): container finished" podID="968ff13b-d5c8-45d8-a85a-3021a07ca49f" containerID="c0d08c2482dc57a95508bdd8517ac38dd95a653176e35691a18a0032b9ce44cb" exitCode=0 Jun 02 20:10:43.451597 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:43.451560 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c" event={"ID":"968ff13b-d5c8-45d8-a85a-3021a07ca49f","Type":"ContainerDied","Data":"c0d08c2482dc57a95508bdd8517ac38dd95a653176e35691a18a0032b9ce44cb"} Jun 02 20:10:43.451597 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:43.451588 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c" event={"ID":"968ff13b-d5c8-45d8-a85a-3021a07ca49f","Type":"ContainerStarted","Data":"3079603433b1c38adda41a496bda6e6658165588f9174d66625db85b25d3a42f"} Jun 02 20:10:44.207815 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:44.207771 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-52fnt"] Jun 02 20:10:44.210120 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:44.210105 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-52fnt" Jun 02 20:10:44.214743 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:44.214719 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 02 20:10:44.214883 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:44.214719 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 02 20:10:44.214932 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:44.214913 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-btchl\"" Jun 02 20:10:44.223498 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:44.223448 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-52fnt"] Jun 02 20:10:44.290040 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:44.289943 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8t2x\" (UniqueName: \"kubernetes.io/projected/8afb8a04-94af-4dc6-b2a2-c130fcc1d2d0-kube-api-access-k8t2x\") pod \"servicemesh-operator3-55f49c5f94-52fnt\" (UID: \"8afb8a04-94af-4dc6-b2a2-c130fcc1d2d0\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-52fnt" Jun 02 20:10:44.290040 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:44.290022 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/8afb8a04-94af-4dc6-b2a2-c130fcc1d2d0-operator-config\") pod \"servicemesh-operator3-55f49c5f94-52fnt\" (UID: \"8afb8a04-94af-4dc6-b2a2-c130fcc1d2d0\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-52fnt" Jun 02 20:10:44.391149 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:44.391108 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8t2x\" (UniqueName: \"kubernetes.io/projected/8afb8a04-94af-4dc6-b2a2-c130fcc1d2d0-kube-api-access-k8t2x\") pod \"servicemesh-operator3-55f49c5f94-52fnt\" (UID: \"8afb8a04-94af-4dc6-b2a2-c130fcc1d2d0\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-52fnt" Jun 02 20:10:44.391315 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:44.391187 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/8afb8a04-94af-4dc6-b2a2-c130fcc1d2d0-operator-config\") pod \"servicemesh-operator3-55f49c5f94-52fnt\" (UID: \"8afb8a04-94af-4dc6-b2a2-c130fcc1d2d0\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-52fnt" Jun 02 20:10:44.393888 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:44.393867 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/8afb8a04-94af-4dc6-b2a2-c130fcc1d2d0-operator-config\") pod \"servicemesh-operator3-55f49c5f94-52fnt\" (UID: \"8afb8a04-94af-4dc6-b2a2-c130fcc1d2d0\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-52fnt" Jun 02 20:10:44.399997 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:44.399974 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8t2x\" (UniqueName: \"kubernetes.io/projected/8afb8a04-94af-4dc6-b2a2-c130fcc1d2d0-kube-api-access-k8t2x\") pod \"servicemesh-operator3-55f49c5f94-52fnt\" (UID: \"8afb8a04-94af-4dc6-b2a2-c130fcc1d2d0\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-52fnt" Jun 02 20:10:44.456328 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:44.456296 2562 generic.go:358] "Generic (PLEG): container finished" podID="968ff13b-d5c8-45d8-a85a-3021a07ca49f" containerID="a22f536fbc3c6de8cc3c7da22ee8e4fff8eb4593a619d65ad75a2c26705246c1" exitCode=0 Jun 02 20:10:44.456522 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:44.456386 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c" event={"ID":"968ff13b-d5c8-45d8-a85a-3021a07ca49f","Type":"ContainerDied","Data":"a22f536fbc3c6de8cc3c7da22ee8e4fff8eb4593a619d65ad75a2c26705246c1"} Jun 02 20:10:44.519148 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:44.519121 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-52fnt" Jun 02 20:10:44.673959 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:44.673813 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-52fnt"] Jun 02 20:10:44.676251 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:10:44.676226 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8afb8a04_94af_4dc6_b2a2_c130fcc1d2d0.slice/crio-9ae5b120e4c4375a28ac1aa1a2f9474107351d8a11d042ffce89b25739280f11 WatchSource:0}: Error finding container 9ae5b120e4c4375a28ac1aa1a2f9474107351d8a11d042ffce89b25739280f11: Status 404 returned error can't find the container with id 9ae5b120e4c4375a28ac1aa1a2f9474107351d8a11d042ffce89b25739280f11 Jun 02 20:10:45.464481 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:45.464423 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-52fnt" event={"ID":"8afb8a04-94af-4dc6-b2a2-c130fcc1d2d0","Type":"ContainerStarted","Data":"9ae5b120e4c4375a28ac1aa1a2f9474107351d8a11d042ffce89b25739280f11"} Jun 02 20:10:45.467030 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:45.467004 2562 generic.go:358] "Generic (PLEG): container finished" podID="968ff13b-d5c8-45d8-a85a-3021a07ca49f" containerID="d391fd2852435b38fdcf60e6b8214aab2a13b133018a5fb2164f1af619d14e02" exitCode=0 Jun 02 20:10:45.467163 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:45.467050 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c" event={"ID":"968ff13b-d5c8-45d8-a85a-3021a07ca49f","Type":"ContainerDied","Data":"d391fd2852435b38fdcf60e6b8214aab2a13b133018a5fb2164f1af619d14e02"} Jun 02 20:10:46.605990 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:46.605958 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c" Jun 02 20:10:46.713332 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:46.713292 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/968ff13b-d5c8-45d8-a85a-3021a07ca49f-util\") pod \"968ff13b-d5c8-45d8-a85a-3021a07ca49f\" (UID: \"968ff13b-d5c8-45d8-a85a-3021a07ca49f\") " Jun 02 20:10:46.713539 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:46.713391 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7887\" (UniqueName: \"kubernetes.io/projected/968ff13b-d5c8-45d8-a85a-3021a07ca49f-kube-api-access-k7887\") pod \"968ff13b-d5c8-45d8-a85a-3021a07ca49f\" (UID: \"968ff13b-d5c8-45d8-a85a-3021a07ca49f\") " Jun 02 20:10:46.713539 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:46.713474 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/968ff13b-d5c8-45d8-a85a-3021a07ca49f-bundle\") pod \"968ff13b-d5c8-45d8-a85a-3021a07ca49f\" (UID: \"968ff13b-d5c8-45d8-a85a-3021a07ca49f\") " Jun 02 20:10:46.714666 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:46.714621 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/968ff13b-d5c8-45d8-a85a-3021a07ca49f-bundle" (OuterVolumeSpecName: "bundle") pod "968ff13b-d5c8-45d8-a85a-3021a07ca49f" (UID: "968ff13b-d5c8-45d8-a85a-3021a07ca49f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:10:46.716126 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:46.716022 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/968ff13b-d5c8-45d8-a85a-3021a07ca49f-kube-api-access-k7887" (OuterVolumeSpecName: "kube-api-access-k7887") pod "968ff13b-d5c8-45d8-a85a-3021a07ca49f" (UID: "968ff13b-d5c8-45d8-a85a-3021a07ca49f"). InnerVolumeSpecName "kube-api-access-k7887". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:10:46.721192 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:46.721116 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/968ff13b-d5c8-45d8-a85a-3021a07ca49f-util" (OuterVolumeSpecName: "util") pod "968ff13b-d5c8-45d8-a85a-3021a07ca49f" (UID: "968ff13b-d5c8-45d8-a85a-3021a07ca49f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:10:46.814423 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:46.814382 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/968ff13b-d5c8-45d8-a85a-3021a07ca49f-util\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:10:46.814423 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:46.814422 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7887\" (UniqueName: \"kubernetes.io/projected/968ff13b-d5c8-45d8-a85a-3021a07ca49f-kube-api-access-k7887\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:10:46.814688 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:46.814442 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/968ff13b-d5c8-45d8-a85a-3021a07ca49f-bundle\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:10:47.476028 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:47.475990 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c" event={"ID":"968ff13b-d5c8-45d8-a85a-3021a07ca49f","Type":"ContainerDied","Data":"3079603433b1c38adda41a496bda6e6658165588f9174d66625db85b25d3a42f"} Jun 02 20:10:47.476028 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:47.476032 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3079603433b1c38adda41a496bda6e6658165588f9174d66625db85b25d3a42f" Jun 02 20:10:47.476228 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:47.476070 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762axzt8c" Jun 02 20:10:49.464446 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.464402 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh"] Jun 02 20:10:49.464841 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.464745 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968ff13b-d5c8-45d8-a85a-3021a07ca49f" containerName="extract" Jun 02 20:10:49.464841 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.464756 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="968ff13b-d5c8-45d8-a85a-3021a07ca49f" containerName="extract" Jun 02 20:10:49.464841 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.464770 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968ff13b-d5c8-45d8-a85a-3021a07ca49f" containerName="util" Jun 02 20:10:49.464841 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.464776 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="968ff13b-d5c8-45d8-a85a-3021a07ca49f" containerName="util" Jun 02 20:10:49.464841 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.464782 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968ff13b-d5c8-45d8-a85a-3021a07ca49f" containerName="pull" Jun 02 20:10:49.464841 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.464788 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="968ff13b-d5c8-45d8-a85a-3021a07ca49f" containerName="pull" Jun 02 20:10:49.464841 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.464835 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="968ff13b-d5c8-45d8-a85a-3021a07ca49f" containerName="extract" Jun 02 20:10:49.466444 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.466427 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.469652 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.469628 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 02 20:10:49.469809 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.469795 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-k8zvn\"" Jun 02 20:10:49.470046 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.470026 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 20:10:49.470122 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.470051 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 02 20:10:49.470276 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.470258 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 02 20:10:49.482361 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.482338 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh"] Jun 02 20:10:49.487107 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.487082 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-52fnt" event={"ID":"8afb8a04-94af-4dc6-b2a2-c130fcc1d2d0","Type":"ContainerStarted","Data":"2b3e890d8862260e32f02f764064a313e8f504781f2aec573ae8601da0597ef8"} Jun 02 20:10:49.487208 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.487197 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-52fnt" Jun 02 20:10:49.540089 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.540022 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-52fnt" podStartSLOduration=1.8006901549999998 podStartE2EDuration="5.540003769s" podCreationTimestamp="2026-06-02 20:10:44 +0000 UTC" firstStartedPulling="2026-06-02 20:10:44.678946351 +0000 UTC m=+539.524232297" lastFinishedPulling="2026-06-02 20:10:48.418259962 +0000 UTC m=+543.263545911" observedRunningTime="2026-06-02 20:10:49.537259111 +0000 UTC m=+544.382545082" watchObservedRunningTime="2026-06-02 20:10:49.540003769 +0000 UTC m=+544.385289738" Jun 02 20:10:49.540089 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.540081 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-local-certs\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.540320 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.540135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-cacerts\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.540320 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.540172 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.540320 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.540200 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqmn5\" (UniqueName: \"kubernetes.io/projected/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-kube-api-access-xqmn5\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.540320 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.540230 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-istio-token\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.540320 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.540255 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.540587 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.540354 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.641059 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.641008 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.641059 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.641053 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-local-certs\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.641312 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.641091 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-cacerts\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.641312 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.641122 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.641312 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.641148 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqmn5\" (UniqueName: \"kubernetes.io/projected/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-kube-api-access-xqmn5\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.641312 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.641178 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-istio-token\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.641312 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.641201 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.641820 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.641788 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.644120 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.644094 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-cacerts\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.644234 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.644133 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.644234 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.644139 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-local-certs\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.644361 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.644338 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.649221 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.649197 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqmn5\" (UniqueName: \"kubernetes.io/projected/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-kube-api-access-xqmn5\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.649657 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.649636 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9c56487-fe97-4c9d-9a76-ec1ef13548fe-istio-token\") pod \"istiod-openshift-gateway-798958bb55-mt7mh\" (UID: \"e9c56487-fe97-4c9d-9a76-ec1ef13548fe\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.777811 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.777704 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:49.925247 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:49.925210 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh"] Jun 02 20:10:49.928295 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:10:49.928264 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9c56487_fe97_4c9d_9a76_ec1ef13548fe.slice/crio-a1a57ddeee7f08eb2a01d9bed322b0ad9a27f4117d5bdbc984b72ce84e9b2128 WatchSource:0}: Error finding container a1a57ddeee7f08eb2a01d9bed322b0ad9a27f4117d5bdbc984b72ce84e9b2128: Status 404 returned error can't find the container with id a1a57ddeee7f08eb2a01d9bed322b0ad9a27f4117d5bdbc984b72ce84e9b2128 Jun 02 20:10:50.491311 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:50.491280 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" event={"ID":"e9c56487-fe97-4c9d-9a76-ec1ef13548fe","Type":"ContainerStarted","Data":"a1a57ddeee7f08eb2a01d9bed322b0ad9a27f4117d5bdbc984b72ce84e9b2128"} Jun 02 20:10:53.121561 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:53.121498 2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 02 20:10:53.121859 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:53.121595 2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 02 20:10:53.503370 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:53.503278 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" event={"ID":"e9c56487-fe97-4c9d-9a76-ec1ef13548fe","Type":"ContainerStarted","Data":"ec0e040ab41cb1a4273c889ca286180ac9a9e176a35cfd028c830cd088445006"} Jun 02 20:10:53.503370 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:53.503337 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:53.525670 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:53.525613 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" podStartSLOduration=1.335178797 podStartE2EDuration="4.525593985s" podCreationTimestamp="2026-06-02 20:10:49 +0000 UTC" firstStartedPulling="2026-06-02 20:10:49.930808867 +0000 UTC m=+544.776094817" lastFinishedPulling="2026-06-02 20:10:53.121224043 +0000 UTC m=+547.966510005" observedRunningTime="2026-06-02 20:10:53.522954026 +0000 UTC m=+548.368240004" watchObservedRunningTime="2026-06-02 20:10:53.525593985 +0000 UTC m=+548.370879956" Jun 02 20:10:54.509105 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:54.509071 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mt7mh" Jun 02 20:10:54.816801 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:54.816767 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-64d74bb8cd-44lft"] Jun 02 20:10:54.819257 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:54.819231 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-64d74bb8cd-44lft" Jun 02 20:10:54.822005 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:54.821972 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 20:10:54.822148 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:54.822072 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8d9lh\"" Jun 02 20:10:54.836035 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:54.836005 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-64d74bb8cd-44lft"] Jun 02 20:10:54.987205 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:54.987166 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/12f4709e-971e-4074-9a86-5d5f7f1a8708-redirect-config\") pod \"dashboard-redirect-64d74bb8cd-44lft\" (UID: \"12f4709e-971e-4074-9a86-5d5f7f1a8708\") " pod="opendatahub/dashboard-redirect-64d74bb8cd-44lft" Jun 02 20:10:54.987377 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:54.987253 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmr6d\" (UniqueName: \"kubernetes.io/projected/12f4709e-971e-4074-9a86-5d5f7f1a8708-kube-api-access-cmr6d\") pod \"dashboard-redirect-64d74bb8cd-44lft\" (UID: \"12f4709e-971e-4074-9a86-5d5f7f1a8708\") " pod="opendatahub/dashboard-redirect-64d74bb8cd-44lft" Jun 02 20:10:55.088179 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:55.088084 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/12f4709e-971e-4074-9a86-5d5f7f1a8708-redirect-config\") pod \"dashboard-redirect-64d74bb8cd-44lft\" (UID: \"12f4709e-971e-4074-9a86-5d5f7f1a8708\") " pod="opendatahub/dashboard-redirect-64d74bb8cd-44lft" Jun 02 20:10:55.088179 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:55.088171 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmr6d\" (UniqueName: \"kubernetes.io/projected/12f4709e-971e-4074-9a86-5d5f7f1a8708-kube-api-access-cmr6d\") pod \"dashboard-redirect-64d74bb8cd-44lft\" (UID: \"12f4709e-971e-4074-9a86-5d5f7f1a8708\") " pod="opendatahub/dashboard-redirect-64d74bb8cd-44lft" Jun 02 20:10:55.088922 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:55.088895 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/12f4709e-971e-4074-9a86-5d5f7f1a8708-redirect-config\") pod \"dashboard-redirect-64d74bb8cd-44lft\" (UID: \"12f4709e-971e-4074-9a86-5d5f7f1a8708\") " pod="opendatahub/dashboard-redirect-64d74bb8cd-44lft" Jun 02 20:10:55.097137 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:55.097104 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmr6d\" (UniqueName: \"kubernetes.io/projected/12f4709e-971e-4074-9a86-5d5f7f1a8708-kube-api-access-cmr6d\") pod \"dashboard-redirect-64d74bb8cd-44lft\" (UID: \"12f4709e-971e-4074-9a86-5d5f7f1a8708\") " pod="opendatahub/dashboard-redirect-64d74bb8cd-44lft" Jun 02 20:10:55.130668 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:55.130638 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-64d74bb8cd-44lft" Jun 02 20:10:55.263644 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:55.263616 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-64d74bb8cd-44lft"] Jun 02 20:10:55.266131 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:10:55.266104 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12f4709e_971e_4074_9a86_5d5f7f1a8708.slice/crio-f758e3b3e2e937b57891321eedf8a7450ee7e37f0ca64be3bd23e13e530a4957 WatchSource:0}: Error finding container f758e3b3e2e937b57891321eedf8a7450ee7e37f0ca64be3bd23e13e530a4957: Status 404 returned error can't find the container with id f758e3b3e2e937b57891321eedf8a7450ee7e37f0ca64be3bd23e13e530a4957 Jun 02 20:10:55.511550 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:55.511444 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-64d74bb8cd-44lft" event={"ID":"12f4709e-971e-4074-9a86-5d5f7f1a8708","Type":"ContainerStarted","Data":"f758e3b3e2e937b57891321eedf8a7450ee7e37f0ca64be3bd23e13e530a4957"} Jun 02 20:10:57.520516 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:57.520480 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-64d74bb8cd-44lft" event={"ID":"12f4709e-971e-4074-9a86-5d5f7f1a8708","Type":"ContainerStarted","Data":"56c7239df9d77f364902229e598c96b2f932d90dfbb04a1052b731782f8a96df"} Jun 02 20:10:57.537146 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:10:57.537093 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-64d74bb8cd-44lft" podStartSLOduration=1.3875611270000001 podStartE2EDuration="3.537078773s" podCreationTimestamp="2026-06-02 20:10:54 +0000 UTC" firstStartedPulling="2026-06-02 20:10:55.267499521 +0000 UTC m=+550.112785467" lastFinishedPulling="2026-06-02 20:10:57.417017167 +0000 UTC m=+552.262303113" observedRunningTime="2026-06-02 20:10:57.534973537 +0000 UTC m=+552.380259505" watchObservedRunningTime="2026-06-02 20:10:57.537078773 +0000 UTC m=+552.382364754" Jun 02 20:11:00.493604 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:11:00.493572 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-52fnt" Jun 02 20:11:11.448585 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:11:11.448555 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-6bg74" Jun 02 20:11:12.449395 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:11:12.449361 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-5thrn" Jun 02 20:11:55.398428 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:11:55.398386 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-vr65f"] Jun 02 20:11:55.402109 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:11:55.402087 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-vr65f" Jun 02 20:11:55.404752 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:11:55.404731 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 20:11:55.404861 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:11:55.404756 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 20:11:55.405443 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:11:55.405430 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-7d845\"" Jun 02 20:11:55.416088 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:11:55.416065 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-vr65f"] Jun 02 20:11:55.478221 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:11:55.478179 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlbb5\" (UniqueName: \"kubernetes.io/projected/4a729b96-675c-4b3b-b591-5377d7e74ce7-kube-api-access-mlbb5\") pod \"authorino-operator-657f44b778-vr65f\" (UID: \"4a729b96-675c-4b3b-b591-5377d7e74ce7\") " pod="kuadrant-system/authorino-operator-657f44b778-vr65f" Jun 02 20:11:55.579563 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:11:55.579507 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mlbb5\" (UniqueName: \"kubernetes.io/projected/4a729b96-675c-4b3b-b591-5377d7e74ce7-kube-api-access-mlbb5\") pod \"authorino-operator-657f44b778-vr65f\" (UID: \"4a729b96-675c-4b3b-b591-5377d7e74ce7\") " pod="kuadrant-system/authorino-operator-657f44b778-vr65f" Jun 02 20:11:55.589671 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:11:55.589633 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlbb5\" (UniqueName: \"kubernetes.io/projected/4a729b96-675c-4b3b-b591-5377d7e74ce7-kube-api-access-mlbb5\") pod \"authorino-operator-657f44b778-vr65f\" (UID: \"4a729b96-675c-4b3b-b591-5377d7e74ce7\") " pod="kuadrant-system/authorino-operator-657f44b778-vr65f" Jun 02 20:11:55.712862 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:11:55.712775 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-vr65f" Jun 02 20:11:55.848650 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:11:55.848627 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-vr65f"] Jun 02 20:11:55.851059 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:11:55.851027 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a729b96_675c_4b3b_b591_5377d7e74ce7.slice/crio-3c835a01d3d07f9c8f35478d17e62473aabd9bb3c7623d4d8f1902dc742a7dfb WatchSource:0}: Error finding container 3c835a01d3d07f9c8f35478d17e62473aabd9bb3c7623d4d8f1902dc742a7dfb: Status 404 returned error can't find the container with id 3c835a01d3d07f9c8f35478d17e62473aabd9bb3c7623d4d8f1902dc742a7dfb Jun 02 20:11:56.725872 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:11:56.725828 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-vr65f" event={"ID":"4a729b96-675c-4b3b-b591-5377d7e74ce7","Type":"ContainerStarted","Data":"3c835a01d3d07f9c8f35478d17e62473aabd9bb3c7623d4d8f1902dc742a7dfb"} Jun 02 20:11:58.734327 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:11:58.734290 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-vr65f" event={"ID":"4a729b96-675c-4b3b-b591-5377d7e74ce7","Type":"ContainerStarted","Data":"fd8cdc7a3bbecedbaf2545331762cabbc33e7b77fea27cc4163d2fd6f2dd2a16"} Jun 02 20:11:58.734778 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:11:58.734404 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-vr65f" Jun 02 20:11:58.759946 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:11:58.759805 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-vr65f" podStartSLOduration=1.487858843 podStartE2EDuration="3.759788493s" podCreationTimestamp="2026-06-02 20:11:55 +0000 UTC" firstStartedPulling="2026-06-02 20:11:55.853144977 +0000 UTC m=+610.698430937" lastFinishedPulling="2026-06-02 20:11:58.125074638 +0000 UTC m=+612.970360587" observedRunningTime="2026-06-02 20:11:58.759110314 +0000 UTC m=+613.604396281" watchObservedRunningTime="2026-06-02 20:11:58.759788493 +0000 UTC m=+613.605074460" Jun 02 20:12:09.739237 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:12:09.739160 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-vr65f" Jun 02 20:13:06.534385 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:06.534345 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-w5j7k"] Jun 02 20:13:06.536817 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:06.536796 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-w5j7k" Jun 02 20:13:06.539003 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:06.538983 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 20:13:06.539113 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:06.539007 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-92vdk\"" Jun 02 20:13:06.546899 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:06.546873 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-w5j7k"] Jun 02 20:13:06.630889 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:06.630855 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-w5j7k"] Jun 02 20:13:06.646445 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:06.646408 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/331c1d48-82a9-4d2c-9f5e-74ab19dd1f18-config-file\") pod \"limitador-limitador-7d549b5b-w5j7k\" (UID: \"331c1d48-82a9-4d2c-9f5e-74ab19dd1f18\") " pod="kuadrant-system/limitador-limitador-7d549b5b-w5j7k" Jun 02 20:13:06.646445 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:06.646451 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xndwg\" (UniqueName: \"kubernetes.io/projected/331c1d48-82a9-4d2c-9f5e-74ab19dd1f18-kube-api-access-xndwg\") pod \"limitador-limitador-7d549b5b-w5j7k\" (UID: \"331c1d48-82a9-4d2c-9f5e-74ab19dd1f18\") " pod="kuadrant-system/limitador-limitador-7d549b5b-w5j7k" Jun 02 20:13:06.747723 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:06.747681 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/331c1d48-82a9-4d2c-9f5e-74ab19dd1f18-config-file\") pod \"limitador-limitador-7d549b5b-w5j7k\" (UID: \"331c1d48-82a9-4d2c-9f5e-74ab19dd1f18\") " pod="kuadrant-system/limitador-limitador-7d549b5b-w5j7k" Jun 02 20:13:06.747723 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:06.747718 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xndwg\" (UniqueName: \"kubernetes.io/projected/331c1d48-82a9-4d2c-9f5e-74ab19dd1f18-kube-api-access-xndwg\") pod \"limitador-limitador-7d549b5b-w5j7k\" (UID: \"331c1d48-82a9-4d2c-9f5e-74ab19dd1f18\") " pod="kuadrant-system/limitador-limitador-7d549b5b-w5j7k" Jun 02 20:13:06.748300 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:06.748279 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/331c1d48-82a9-4d2c-9f5e-74ab19dd1f18-config-file\") pod \"limitador-limitador-7d549b5b-w5j7k\" (UID: \"331c1d48-82a9-4d2c-9f5e-74ab19dd1f18\") " pod="kuadrant-system/limitador-limitador-7d549b5b-w5j7k" Jun 02 20:13:06.756093 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:06.756054 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xndwg\" (UniqueName: \"kubernetes.io/projected/331c1d48-82a9-4d2c-9f5e-74ab19dd1f18-kube-api-access-xndwg\") pod \"limitador-limitador-7d549b5b-w5j7k\" (UID: \"331c1d48-82a9-4d2c-9f5e-74ab19dd1f18\") " pod="kuadrant-system/limitador-limitador-7d549b5b-w5j7k" Jun 02 20:13:06.848261 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:06.848224 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-w5j7k" Jun 02 20:13:06.983095 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:06.982918 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-w5j7k"] Jun 02 20:13:06.985492 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:13:06.985430 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod331c1d48_82a9_4d2c_9f5e_74ab19dd1f18.slice/crio-4a4760598676bbbfbce79fe2c4f29569e066316195a4366a874425575d9751d9 WatchSource:0}: Error finding container 4a4760598676bbbfbce79fe2c4f29569e066316195a4366a874425575d9751d9: Status 404 returned error can't find the container with id 4a4760598676bbbfbce79fe2c4f29569e066316195a4366a874425575d9751d9 Jun 02 20:13:07.981888 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:07.981848 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-w5j7k" event={"ID":"331c1d48-82a9-4d2c-9f5e-74ab19dd1f18","Type":"ContainerStarted","Data":"4a4760598676bbbfbce79fe2c4f29569e066316195a4366a874425575d9751d9"} Jun 02 20:13:09.989709 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:09.989616 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-w5j7k" event={"ID":"331c1d48-82a9-4d2c-9f5e-74ab19dd1f18","Type":"ContainerStarted","Data":"11158bac6b1e8851bb761efaa325ba440870cee7a473bc8726d1c4708c2c4e5c"} Jun 02 20:13:09.989709 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:09.989686 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-w5j7k" Jun 02 20:13:10.009360 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:10.009312 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-w5j7k" podStartSLOduration=1.279610232 podStartE2EDuration="4.00929906s" podCreationTimestamp="2026-06-02 20:13:06 +0000 UTC" firstStartedPulling="2026-06-02 20:13:06.987373147 +0000 UTC m=+681.832659096" lastFinishedPulling="2026-06-02 20:13:09.717061979 +0000 UTC m=+684.562347924" observedRunningTime="2026-06-02 20:13:10.007748365 +0000 UTC m=+684.853034333" watchObservedRunningTime="2026-06-02 20:13:10.00929906 +0000 UTC m=+684.854585028" Jun 02 20:13:20.994844 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:20.994809 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-w5j7k" Jun 02 20:13:23.200009 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:23.199971 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-w5j7k"] Jun 02 20:13:23.200622 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:23.200202 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-w5j7k" podUID="331c1d48-82a9-4d2c-9f5e-74ab19dd1f18" containerName="limitador" containerID="cri-o://11158bac6b1e8851bb761efaa325ba440870cee7a473bc8726d1c4708c2c4e5c" gracePeriod=30 Jun 02 20:13:23.738811 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:23.738788 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-w5j7k" Jun 02 20:13:23.776440 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:23.776371 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xndwg\" (UniqueName: \"kubernetes.io/projected/331c1d48-82a9-4d2c-9f5e-74ab19dd1f18-kube-api-access-xndwg\") pod \"331c1d48-82a9-4d2c-9f5e-74ab19dd1f18\" (UID: \"331c1d48-82a9-4d2c-9f5e-74ab19dd1f18\") " Jun 02 20:13:23.776440 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:23.776438 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/331c1d48-82a9-4d2c-9f5e-74ab19dd1f18-config-file\") pod \"331c1d48-82a9-4d2c-9f5e-74ab19dd1f18\" (UID: \"331c1d48-82a9-4d2c-9f5e-74ab19dd1f18\") " Jun 02 20:13:23.776815 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:23.776790 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/331c1d48-82a9-4d2c-9f5e-74ab19dd1f18-config-file" (OuterVolumeSpecName: "config-file") pod "331c1d48-82a9-4d2c-9f5e-74ab19dd1f18" (UID: "331c1d48-82a9-4d2c-9f5e-74ab19dd1f18"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:13:23.778735 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:23.778711 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/331c1d48-82a9-4d2c-9f5e-74ab19dd1f18-kube-api-access-xndwg" (OuterVolumeSpecName: "kube-api-access-xndwg") pod "331c1d48-82a9-4d2c-9f5e-74ab19dd1f18" (UID: "331c1d48-82a9-4d2c-9f5e-74ab19dd1f18"). InnerVolumeSpecName "kube-api-access-xndwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:13:23.876983 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:23.876940 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xndwg\" (UniqueName: \"kubernetes.io/projected/331c1d48-82a9-4d2c-9f5e-74ab19dd1f18-kube-api-access-xndwg\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:13:23.876983 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:23.876974 2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/331c1d48-82a9-4d2c-9f5e-74ab19dd1f18-config-file\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:13:24.045663 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:24.045574 2562 generic.go:358] "Generic (PLEG): container finished" podID="331c1d48-82a9-4d2c-9f5e-74ab19dd1f18" containerID="11158bac6b1e8851bb761efaa325ba440870cee7a473bc8726d1c4708c2c4e5c" exitCode=0 Jun 02 20:13:24.045663 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:24.045644 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-w5j7k" Jun 02 20:13:24.045883 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:24.045663 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-w5j7k" event={"ID":"331c1d48-82a9-4d2c-9f5e-74ab19dd1f18","Type":"ContainerDied","Data":"11158bac6b1e8851bb761efaa325ba440870cee7a473bc8726d1c4708c2c4e5c"} Jun 02 20:13:24.045883 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:24.045700 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-w5j7k" event={"ID":"331c1d48-82a9-4d2c-9f5e-74ab19dd1f18","Type":"ContainerDied","Data":"4a4760598676bbbfbce79fe2c4f29569e066316195a4366a874425575d9751d9"} Jun 02 20:13:24.045883 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:24.045719 2562 scope.go:117] "RemoveContainer" containerID="11158bac6b1e8851bb761efaa325ba440870cee7a473bc8726d1c4708c2c4e5c" Jun 02 20:13:24.054634 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:24.054616 2562 scope.go:117] "RemoveContainer" containerID="11158bac6b1e8851bb761efaa325ba440870cee7a473bc8726d1c4708c2c4e5c" Jun 02 20:13:24.054923 ip-10-0-132-46 kubenswrapper[2562]: E0602 20:13:24.054904 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11158bac6b1e8851bb761efaa325ba440870cee7a473bc8726d1c4708c2c4e5c\": container with ID starting with 11158bac6b1e8851bb761efaa325ba440870cee7a473bc8726d1c4708c2c4e5c not found: ID does not exist" containerID="11158bac6b1e8851bb761efaa325ba440870cee7a473bc8726d1c4708c2c4e5c" Jun 02 20:13:24.054975 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:24.054932 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11158bac6b1e8851bb761efaa325ba440870cee7a473bc8726d1c4708c2c4e5c"} err="failed to get container status \"11158bac6b1e8851bb761efaa325ba440870cee7a473bc8726d1c4708c2c4e5c\": rpc error: code = NotFound desc = could not find container \"11158bac6b1e8851bb761efaa325ba440870cee7a473bc8726d1c4708c2c4e5c\": container with ID starting with 11158bac6b1e8851bb761efaa325ba440870cee7a473bc8726d1c4708c2c4e5c not found: ID does not exist" Jun 02 20:13:24.066994 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:24.066969 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-w5j7k"] Jun 02 20:13:24.071164 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:24.071144 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-w5j7k"] Jun 02 20:13:25.702840 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:25.702805 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="331c1d48-82a9-4d2c-9f5e-74ab19dd1f18" path="/var/lib/kubelet/pods/331c1d48-82a9-4d2c-9f5e-74ab19dd1f18/volumes" Jun 02 20:13:27.573006 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:27.572972 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-d5t8p"] Jun 02 20:13:27.573382 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:27.573280 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="331c1d48-82a9-4d2c-9f5e-74ab19dd1f18" containerName="limitador" Jun 02 20:13:27.573382 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:27.573294 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="331c1d48-82a9-4d2c-9f5e-74ab19dd1f18" containerName="limitador" Jun 02 20:13:27.573382 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:27.573362 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="331c1d48-82a9-4d2c-9f5e-74ab19dd1f18" containerName="limitador" Jun 02 20:13:27.575754 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:27.575737 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-d5t8p" Jun 02 20:13:27.578584 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:27.578560 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 02 20:13:27.587188 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:27.587161 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-d5t8p"] Jun 02 20:13:27.603726 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:27.603702 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/18607ada-9989-4202-9eda-dbd8aac064f8-data\") pod \"postgres-68c4fbbd6f-d5t8p\" (UID: \"18607ada-9989-4202-9eda-dbd8aac064f8\") " pod="opendatahub/postgres-68c4fbbd6f-d5t8p" Jun 02 20:13:27.603839 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:27.603741 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q8fl\" (UniqueName: \"kubernetes.io/projected/18607ada-9989-4202-9eda-dbd8aac064f8-kube-api-access-6q8fl\") pod \"postgres-68c4fbbd6f-d5t8p\" (UID: \"18607ada-9989-4202-9eda-dbd8aac064f8\") " pod="opendatahub/postgres-68c4fbbd6f-d5t8p" Jun 02 20:13:27.704383 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:27.704349 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/18607ada-9989-4202-9eda-dbd8aac064f8-data\") pod \"postgres-68c4fbbd6f-d5t8p\" (UID: \"18607ada-9989-4202-9eda-dbd8aac064f8\") " pod="opendatahub/postgres-68c4fbbd6f-d5t8p" Jun 02 20:13:27.704579 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:27.704394 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6q8fl\" (UniqueName: \"kubernetes.io/projected/18607ada-9989-4202-9eda-dbd8aac064f8-kube-api-access-6q8fl\") pod \"postgres-68c4fbbd6f-d5t8p\" (UID: \"18607ada-9989-4202-9eda-dbd8aac064f8\") " pod="opendatahub/postgres-68c4fbbd6f-d5t8p" Jun 02 20:13:27.704844 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:27.704819 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/18607ada-9989-4202-9eda-dbd8aac064f8-data\") pod \"postgres-68c4fbbd6f-d5t8p\" (UID: \"18607ada-9989-4202-9eda-dbd8aac064f8\") " pod="opendatahub/postgres-68c4fbbd6f-d5t8p" Jun 02 20:13:27.713338 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:27.713311 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q8fl\" (UniqueName: \"kubernetes.io/projected/18607ada-9989-4202-9eda-dbd8aac064f8-kube-api-access-6q8fl\") pod \"postgres-68c4fbbd6f-d5t8p\" (UID: \"18607ada-9989-4202-9eda-dbd8aac064f8\") " pod="opendatahub/postgres-68c4fbbd6f-d5t8p" Jun 02 20:13:27.887607 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:27.887512 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-d5t8p" Jun 02 20:13:28.034083 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:28.034049 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-d5t8p"] Jun 02 20:13:28.035310 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:13:28.035280 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18607ada_9989_4202_9eda_dbd8aac064f8.slice/crio-13e774d73b90a58dac75e08d656ca19b80b73395d1571bf87932eb7bfcdfed3c WatchSource:0}: Error finding container 13e774d73b90a58dac75e08d656ca19b80b73395d1571bf87932eb7bfcdfed3c: Status 404 returned error can't find the container with id 13e774d73b90a58dac75e08d656ca19b80b73395d1571bf87932eb7bfcdfed3c Jun 02 20:13:28.062977 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:28.062940 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-d5t8p" event={"ID":"18607ada-9989-4202-9eda-dbd8aac064f8","Type":"ContainerStarted","Data":"13e774d73b90a58dac75e08d656ca19b80b73395d1571bf87932eb7bfcdfed3c"} Jun 02 20:13:31.076667 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:31.076627 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-d5t8p" event={"ID":"18607ada-9989-4202-9eda-dbd8aac064f8","Type":"ContainerStarted","Data":"78850b4b475c0afa6b7e11df83b300e33b2d80ad457ad0f3dea8377caa815a34"} Jun 02 20:13:31.077131 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:31.076758 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-d5t8p" Jun 02 20:13:31.095100 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:31.095048 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-d5t8p" podStartSLOduration=1.7167182269999999 podStartE2EDuration="4.095033211s" podCreationTimestamp="2026-06-02 20:13:27 +0000 UTC" firstStartedPulling="2026-06-02 20:13:28.036540338 +0000 UTC m=+702.881826286" lastFinishedPulling="2026-06-02 20:13:30.414855321 +0000 UTC m=+705.260141270" observedRunningTime="2026-06-02 20:13:31.09405502 +0000 UTC m=+705.939340992" watchObservedRunningTime="2026-06-02 20:13:31.095033211 +0000 UTC m=+705.940319239" Jun 02 20:13:37.114401 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:37.114331 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-d5t8p" Jun 02 20:13:38.908127 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:38.908089 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr"] Jun 02 20:13:38.945596 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:38.945562 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr"] Jun 02 20:13:38.945756 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:38.945722 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr" Jun 02 20:13:38.948299 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:38.948254 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 20:13:38.948485 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:38.948448 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t9r55\"" Jun 02 20:13:38.949039 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:38.949021 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 20:13:39.000368 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:39.000334 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41feddd4-d623-464a-acab-b6b02044d670-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr\" (UID: \"41feddd4-d623-464a-acab-b6b02044d670\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr" Jun 02 20:13:39.000368 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:39.000370 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p9wj\" (UniqueName: \"kubernetes.io/projected/41feddd4-d623-464a-acab-b6b02044d670-kube-api-access-9p9wj\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr\" (UID: \"41feddd4-d623-464a-acab-b6b02044d670\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr" Jun 02 20:13:39.000599 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:39.000396 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41feddd4-d623-464a-acab-b6b02044d670-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr\" (UID: \"41feddd4-d623-464a-acab-b6b02044d670\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr" Jun 02 20:13:39.101152 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:39.101113 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41feddd4-d623-464a-acab-b6b02044d670-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr\" (UID: \"41feddd4-d623-464a-acab-b6b02044d670\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr" Jun 02 20:13:39.101152 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:39.101153 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9p9wj\" (UniqueName: \"kubernetes.io/projected/41feddd4-d623-464a-acab-b6b02044d670-kube-api-access-9p9wj\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr\" (UID: \"41feddd4-d623-464a-acab-b6b02044d670\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr" Jun 02 20:13:39.101367 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:39.101178 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41feddd4-d623-464a-acab-b6b02044d670-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr\" (UID: \"41feddd4-d623-464a-acab-b6b02044d670\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr" Jun 02 20:13:39.101612 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:39.101596 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41feddd4-d623-464a-acab-b6b02044d670-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr\" (UID: \"41feddd4-d623-464a-acab-b6b02044d670\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr" Jun 02 20:13:39.101647 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:39.101620 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41feddd4-d623-464a-acab-b6b02044d670-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr\" (UID: \"41feddd4-d623-464a-acab-b6b02044d670\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr" Jun 02 20:13:39.110443 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:39.110411 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p9wj\" (UniqueName: \"kubernetes.io/projected/41feddd4-d623-464a-acab-b6b02044d670-kube-api-access-9p9wj\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr\" (UID: \"41feddd4-d623-464a-acab-b6b02044d670\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr" Jun 02 20:13:39.254924 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:39.254837 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr" Jun 02 20:13:39.386680 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:39.386654 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr"] Jun 02 20:13:39.389174 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:13:39.389144 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41feddd4_d623_464a_acab_b6b02044d670.slice/crio-cfc385590d8d263a626e4118299c7ed8a7359761d233dd4ae46c6827798a9d49 WatchSource:0}: Error finding container cfc385590d8d263a626e4118299c7ed8a7359761d233dd4ae46c6827798a9d49: Status 404 returned error can't find the container with id cfc385590d8d263a626e4118299c7ed8a7359761d233dd4ae46c6827798a9d49 Jun 02 20:13:40.113260 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:40.113222 2562 generic.go:358] "Generic (PLEG): container finished" podID="41feddd4-d623-464a-acab-b6b02044d670" containerID="5cec2afa7698084f65b7a6dea5ccf8ef7f97a7fb0a6d625b8bd9f2189610ed2b" exitCode=0 Jun 02 20:13:40.113639 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:40.113303 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr" event={"ID":"41feddd4-d623-464a-acab-b6b02044d670","Type":"ContainerDied","Data":"5cec2afa7698084f65b7a6dea5ccf8ef7f97a7fb0a6d625b8bd9f2189610ed2b"} Jun 02 20:13:40.113639 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:40.113343 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr" event={"ID":"41feddd4-d623-464a-acab-b6b02044d670","Type":"ContainerStarted","Data":"cfc385590d8d263a626e4118299c7ed8a7359761d233dd4ae46c6827798a9d49"} Jun 02 20:13:41.119284 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:41.119247 2562 generic.go:358] "Generic (PLEG): container finished" podID="41feddd4-d623-464a-acab-b6b02044d670" containerID="5e149463bdc49ef02809ffec822c46cdbbde19be4f5016e0e7a317b97deb372a" exitCode=0 Jun 02 20:13:41.119729 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:41.119336 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr" event={"ID":"41feddd4-d623-464a-acab-b6b02044d670","Type":"ContainerDied","Data":"5e149463bdc49ef02809ffec822c46cdbbde19be4f5016e0e7a317b97deb372a"} Jun 02 20:13:42.124658 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:42.124624 2562 generic.go:358] "Generic (PLEG): container finished" podID="41feddd4-d623-464a-acab-b6b02044d670" containerID="1bb7a07896b6903ce9ba3565c421b4c291e920125d0ba4fb522ea02791359bb7" exitCode=0 Jun 02 20:13:42.125045 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:42.124707 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr" event={"ID":"41feddd4-d623-464a-acab-b6b02044d670","Type":"ContainerDied","Data":"1bb7a07896b6903ce9ba3565c421b4c291e920125d0ba4fb522ea02791359bb7"} Jun 02 20:13:43.256862 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:43.256840 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr" Jun 02 20:13:43.335917 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:43.335878 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41feddd4-d623-464a-acab-b6b02044d670-util\") pod \"41feddd4-d623-464a-acab-b6b02044d670\" (UID: \"41feddd4-d623-464a-acab-b6b02044d670\") " Jun 02 20:13:43.336055 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:43.335936 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9p9wj\" (UniqueName: \"kubernetes.io/projected/41feddd4-d623-464a-acab-b6b02044d670-kube-api-access-9p9wj\") pod \"41feddd4-d623-464a-acab-b6b02044d670\" (UID: \"41feddd4-d623-464a-acab-b6b02044d670\") " Jun 02 20:13:43.336055 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:43.336005 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41feddd4-d623-464a-acab-b6b02044d670-bundle\") pod \"41feddd4-d623-464a-acab-b6b02044d670\" (UID: \"41feddd4-d623-464a-acab-b6b02044d670\") " Jun 02 20:13:43.336605 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:43.336568 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41feddd4-d623-464a-acab-b6b02044d670-bundle" (OuterVolumeSpecName: "bundle") pod "41feddd4-d623-464a-acab-b6b02044d670" (UID: "41feddd4-d623-464a-acab-b6b02044d670"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:13:43.338115 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:43.338091 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41feddd4-d623-464a-acab-b6b02044d670-kube-api-access-9p9wj" (OuterVolumeSpecName: "kube-api-access-9p9wj") pod "41feddd4-d623-464a-acab-b6b02044d670" (UID: "41feddd4-d623-464a-acab-b6b02044d670"). InnerVolumeSpecName "kube-api-access-9p9wj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:13:43.340975 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:43.340954 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41feddd4-d623-464a-acab-b6b02044d670-util" (OuterVolumeSpecName: "util") pod "41feddd4-d623-464a-acab-b6b02044d670" (UID: "41feddd4-d623-464a-acab-b6b02044d670"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:13:43.437067 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:43.436970 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p9wj\" (UniqueName: \"kubernetes.io/projected/41feddd4-d623-464a-acab-b6b02044d670-kube-api-access-9p9wj\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:13:43.437067 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:43.437006 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41feddd4-d623-464a-acab-b6b02044d670-bundle\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:13:43.437067 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:43.437018 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41feddd4-d623-464a-acab-b6b02044d670-util\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:13:44.133355 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:44.133327 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr" Jun 02 20:13:44.133355 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:44.133341 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70xctxr" event={"ID":"41feddd4-d623-464a-acab-b6b02044d670","Type":"ContainerDied","Data":"cfc385590d8d263a626e4118299c7ed8a7359761d233dd4ae46c6827798a9d49"} Jun 02 20:13:44.133580 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:44.133370 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfc385590d8d263a626e4118299c7ed8a7359761d233dd4ae46c6827798a9d49" Jun 02 20:13:46.626000 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:46.625962 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-njlqq"] Jun 02 20:13:46.626368 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:46.626265 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41feddd4-d623-464a-acab-b6b02044d670" containerName="extract" Jun 02 20:13:46.626368 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:46.626276 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="41feddd4-d623-464a-acab-b6b02044d670" containerName="extract" Jun 02 20:13:46.626368 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:46.626291 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41feddd4-d623-464a-acab-b6b02044d670" containerName="util" Jun 02 20:13:46.626368 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:46.626296 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="41feddd4-d623-464a-acab-b6b02044d670" containerName="util" Jun 02 20:13:46.626368 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:46.626307 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41feddd4-d623-464a-acab-b6b02044d670" containerName="pull" Jun 02 20:13:46.626368 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:46.626312 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="41feddd4-d623-464a-acab-b6b02044d670" containerName="pull" Jun 02 20:13:46.626368 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:46.626366 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="41feddd4-d623-464a-acab-b6b02044d670" containerName="extract" Jun 02 20:13:46.628821 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:46.628804 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-njlqq" Jun 02 20:13:46.631318 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:46.631296 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 20:13:46.631453 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:46.631300 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 20:13:46.631996 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:46.631981 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-8fqfr\"" Jun 02 20:13:46.640987 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:46.640964 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-njlqq"] Jun 02 20:13:46.766435 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:46.766403 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t9xk\" (UniqueName: \"kubernetes.io/projected/1f6e7e93-57ad-4ae2-8a98-d143040d5630-kube-api-access-7t9xk\") pod \"keycloak-operator-7864d68cbd-njlqq\" (UID: \"1f6e7e93-57ad-4ae2-8a98-d143040d5630\") " pod="keycloak-system/keycloak-operator-7864d68cbd-njlqq" Jun 02 20:13:46.867773 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:46.867741 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7t9xk\" (UniqueName: \"kubernetes.io/projected/1f6e7e93-57ad-4ae2-8a98-d143040d5630-kube-api-access-7t9xk\") pod \"keycloak-operator-7864d68cbd-njlqq\" (UID: \"1f6e7e93-57ad-4ae2-8a98-d143040d5630\") " pod="keycloak-system/keycloak-operator-7864d68cbd-njlqq" Jun 02 20:13:46.878981 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:46.878912 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t9xk\" (UniqueName: \"kubernetes.io/projected/1f6e7e93-57ad-4ae2-8a98-d143040d5630-kube-api-access-7t9xk\") pod \"keycloak-operator-7864d68cbd-njlqq\" (UID: \"1f6e7e93-57ad-4ae2-8a98-d143040d5630\") " pod="keycloak-system/keycloak-operator-7864d68cbd-njlqq" Jun 02 20:13:46.938916 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:46.938879 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-njlqq" Jun 02 20:13:47.086327 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:47.086263 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-njlqq"] Jun 02 20:13:47.088836 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:13:47.088807 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6e7e93_57ad_4ae2_8a98_d143040d5630.slice/crio-8c4ff6a799a7eafc99cfdf38dcc03e4fe1b51b5348529bc7d1d31def506c9e5a WatchSource:0}: Error finding container 8c4ff6a799a7eafc99cfdf38dcc03e4fe1b51b5348529bc7d1d31def506c9e5a: Status 404 returned error can't find the container with id 8c4ff6a799a7eafc99cfdf38dcc03e4fe1b51b5348529bc7d1d31def506c9e5a Jun 02 20:13:47.148839 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:47.148733 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-njlqq" event={"ID":"1f6e7e93-57ad-4ae2-8a98-d143040d5630","Type":"ContainerStarted","Data":"8c4ff6a799a7eafc99cfdf38dcc03e4fe1b51b5348529bc7d1d31def506c9e5a"} Jun 02 20:13:54.179719 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:54.179680 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-njlqq" event={"ID":"1f6e7e93-57ad-4ae2-8a98-d143040d5630","Type":"ContainerStarted","Data":"7c67789ceb19d40d674e42ca32a6c6236910cbda9cb4e85e63276706ee114731"} Jun 02 20:13:54.201409 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:13:54.201363 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-njlqq" podStartSLOduration=1.77536892 podStartE2EDuration="8.201348118s" podCreationTimestamp="2026-06-02 20:13:46 +0000 UTC" firstStartedPulling="2026-06-02 20:13:47.090354824 +0000 UTC m=+721.935640770" lastFinishedPulling="2026-06-02 20:13:53.516334004 +0000 UTC m=+728.361619968" observedRunningTime="2026-06-02 20:13:54.200179203 +0000 UTC m=+729.045465171" watchObservedRunningTime="2026-06-02 20:13:54.201348118 +0000 UTC m=+729.046634086" Jun 02 20:19:09.669779 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:19:09.669743 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bb676c484-nvfld"] Jun 02 20:19:09.671789 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:19:09.671772 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bb676c484-nvfld" Jun 02 20:19:09.674201 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:19:09.674184 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-h65xp\"" Jun 02 20:19:09.674888 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:19:09.674870 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 02 20:19:09.685393 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:19:09.685368 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bb676c484-nvfld"] Jun 02 20:19:09.831871 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:19:09.831829 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4n96\" (UniqueName: \"kubernetes.io/projected/a8c5a5d1-60d8-4c32-888c-dcf006bf6cb9-kube-api-access-r4n96\") pod \"maas-controller-7bb676c484-nvfld\" (UID: \"a8c5a5d1-60d8-4c32-888c-dcf006bf6cb9\") " pod="opendatahub/maas-controller-7bb676c484-nvfld" Jun 02 20:19:09.932814 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:19:09.932718 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r4n96\" (UniqueName: \"kubernetes.io/projected/a8c5a5d1-60d8-4c32-888c-dcf006bf6cb9-kube-api-access-r4n96\") pod \"maas-controller-7bb676c484-nvfld\" (UID: \"a8c5a5d1-60d8-4c32-888c-dcf006bf6cb9\") " pod="opendatahub/maas-controller-7bb676c484-nvfld" Jun 02 20:19:09.946116 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:19:09.946089 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4n96\" (UniqueName: \"kubernetes.io/projected/a8c5a5d1-60d8-4c32-888c-dcf006bf6cb9-kube-api-access-r4n96\") pod \"maas-controller-7bb676c484-nvfld\" (UID: \"a8c5a5d1-60d8-4c32-888c-dcf006bf6cb9\") " pod="opendatahub/maas-controller-7bb676c484-nvfld" Jun 02 20:19:09.981528 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:19:09.981487 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bb676c484-nvfld" Jun 02 20:19:10.119618 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:19:10.119589 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bb676c484-nvfld"] Jun 02 20:19:10.121216 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:19:10.121190 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8c5a5d1_60d8_4c32_888c_dcf006bf6cb9.slice/crio-9a4c961039441efbeadf279864586f1d98a689c0fe12144b052ccd11168f5245 WatchSource:0}: Error finding container 9a4c961039441efbeadf279864586f1d98a689c0fe12144b052ccd11168f5245: Status 404 returned error can't find the container with id 9a4c961039441efbeadf279864586f1d98a689c0fe12144b052ccd11168f5245 Jun 02 20:19:10.122536 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:19:10.122520 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 20:19:10.282654 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:19:10.282566 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bb676c484-nvfld" event={"ID":"a8c5a5d1-60d8-4c32-888c-dcf006bf6cb9","Type":"ContainerStarted","Data":"9a4c961039441efbeadf279864586f1d98a689c0fe12144b052ccd11168f5245"} Jun 02 20:19:13.297182 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:19:13.297146 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bb676c484-nvfld" event={"ID":"a8c5a5d1-60d8-4c32-888c-dcf006bf6cb9","Type":"ContainerStarted","Data":"fa73bd97a5d56a2c7279ae27f82626e0f947764577301a0263c72527e8c42615"} Jun 02 20:19:13.297591 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:19:13.297292 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bb676c484-nvfld" Jun 02 20:19:13.316846 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:19:13.316783 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7bb676c484-nvfld" podStartSLOduration=1.9385228799999998 podStartE2EDuration="4.316765933s" podCreationTimestamp="2026-06-02 20:19:09 +0000 UTC" firstStartedPulling="2026-06-02 20:19:10.122640885 +0000 UTC m=+1044.967926830" lastFinishedPulling="2026-06-02 20:19:12.500883923 +0000 UTC m=+1047.346169883" observedRunningTime="2026-06-02 20:19:13.315791647 +0000 UTC m=+1048.161077616" watchObservedRunningTime="2026-06-02 20:19:13.316765933 +0000 UTC m=+1048.162051902" Jun 02 20:19:24.306359 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:19:24.306319 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bb676c484-nvfld" Jun 02 20:30:00.146588 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:00.146545 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29673870-94jl6"] Jun 02 20:30:00.149883 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:00.149864 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673870-94jl6" Jun 02 20:30:00.152213 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:00.152194 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-b2dh4\"" Jun 02 20:30:00.156476 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:00.156420 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29673870-94jl6"] Jun 02 20:30:00.236970 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:00.236923 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgqpj\" (UniqueName: \"kubernetes.io/projected/21bdb663-7c37-4115-a59c-cc3836edc2cc-kube-api-access-tgqpj\") pod \"maas-api-key-cleanup-29673870-94jl6\" (UID: \"21bdb663-7c37-4115-a59c-cc3836edc2cc\") " pod="opendatahub/maas-api-key-cleanup-29673870-94jl6" Jun 02 20:30:00.338024 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:00.337980 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tgqpj\" (UniqueName: \"kubernetes.io/projected/21bdb663-7c37-4115-a59c-cc3836edc2cc-kube-api-access-tgqpj\") pod \"maas-api-key-cleanup-29673870-94jl6\" (UID: \"21bdb663-7c37-4115-a59c-cc3836edc2cc\") " pod="opendatahub/maas-api-key-cleanup-29673870-94jl6" Jun 02 20:30:00.347310 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:00.347281 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgqpj\" (UniqueName: \"kubernetes.io/projected/21bdb663-7c37-4115-a59c-cc3836edc2cc-kube-api-access-tgqpj\") pod \"maas-api-key-cleanup-29673870-94jl6\" (UID: \"21bdb663-7c37-4115-a59c-cc3836edc2cc\") " pod="opendatahub/maas-api-key-cleanup-29673870-94jl6" Jun 02 20:30:00.460834 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:00.460742 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673870-94jl6" Jun 02 20:30:00.596363 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:00.596331 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29673870-94jl6"] Jun 02 20:30:00.598645 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:30:00.598619 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21bdb663_7c37_4115_a59c_cc3836edc2cc.slice/crio-664435f0b6c2272aa6074d472d92931d9974adeae36ace9d40ea0b8b46f8a30a WatchSource:0}: Error finding container 664435f0b6c2272aa6074d472d92931d9974adeae36ace9d40ea0b8b46f8a30a: Status 404 returned error can't find the container with id 664435f0b6c2272aa6074d472d92931d9974adeae36ace9d40ea0b8b46f8a30a Jun 02 20:30:00.600760 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:00.600741 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 20:30:00.617266 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:00.617214 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673870-94jl6" event={"ID":"21bdb663-7c37-4115-a59c-cc3836edc2cc","Type":"ContainerStarted","Data":"664435f0b6c2272aa6074d472d92931d9974adeae36ace9d40ea0b8b46f8a30a"} Jun 02 20:30:17.685026 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:17.684990 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673870-94jl6" event={"ID":"21bdb663-7c37-4115-a59c-cc3836edc2cc","Type":"ContainerStarted","Data":"77757878f6a5809341c3332400a21bc20cfeb402a28fa1a322e6305cb58a3fc0"} Jun 02 20:30:17.701946 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:17.701896 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29673870-94jl6" podStartSLOduration=1.245023798 podStartE2EDuration="17.701884704s" podCreationTimestamp="2026-06-02 20:30:00 +0000 UTC" firstStartedPulling="2026-06-02 20:30:00.600893662 +0000 UTC m=+1695.446179607" lastFinishedPulling="2026-06-02 20:30:17.057754557 +0000 UTC m=+1711.903040513" observedRunningTime="2026-06-02 20:30:17.700562814 +0000 UTC m=+1712.545848782" watchObservedRunningTime="2026-06-02 20:30:17.701884704 +0000 UTC m=+1712.547170673" Jun 02 20:30:18.690137 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:18.690100 2562 generic.go:358] "Generic (PLEG): container finished" podID="21bdb663-7c37-4115-a59c-cc3836edc2cc" containerID="77757878f6a5809341c3332400a21bc20cfeb402a28fa1a322e6305cb58a3fc0" exitCode=0 Jun 02 20:30:18.690673 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:18.690185 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673870-94jl6" event={"ID":"21bdb663-7c37-4115-a59c-cc3836edc2cc","Type":"ContainerDied","Data":"77757878f6a5809341c3332400a21bc20cfeb402a28fa1a322e6305cb58a3fc0"} Jun 02 20:30:19.824671 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:19.824641 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673870-94jl6" Jun 02 20:30:19.909358 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:19.909322 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgqpj\" (UniqueName: \"kubernetes.io/projected/21bdb663-7c37-4115-a59c-cc3836edc2cc-kube-api-access-tgqpj\") pod \"21bdb663-7c37-4115-a59c-cc3836edc2cc\" (UID: \"21bdb663-7c37-4115-a59c-cc3836edc2cc\") " Jun 02 20:30:19.911633 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:19.911610 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21bdb663-7c37-4115-a59c-cc3836edc2cc-kube-api-access-tgqpj" (OuterVolumeSpecName: "kube-api-access-tgqpj") pod "21bdb663-7c37-4115-a59c-cc3836edc2cc" (UID: "21bdb663-7c37-4115-a59c-cc3836edc2cc"). InnerVolumeSpecName "kube-api-access-tgqpj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:30:20.010880 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:20.010785 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgqpj\" (UniqueName: \"kubernetes.io/projected/21bdb663-7c37-4115-a59c-cc3836edc2cc-kube-api-access-tgqpj\") on node \"ip-10-0-132-46.ec2.internal\" DevicePath \"\"" Jun 02 20:30:20.698497 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:20.698446 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673870-94jl6" Jun 02 20:30:20.698497 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:20.698481 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673870-94jl6" event={"ID":"21bdb663-7c37-4115-a59c-cc3836edc2cc","Type":"ContainerDied","Data":"664435f0b6c2272aa6074d472d92931d9974adeae36ace9d40ea0b8b46f8a30a"} Jun 02 20:30:20.698708 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:30:20.698509 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="664435f0b6c2272aa6074d472d92931d9974adeae36ace9d40ea0b8b46f8a30a" Jun 02 20:40:46.609813 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:40:46.609732 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-64d74bb8cd-44lft_12f4709e-971e-4074-9a86-5d5f7f1a8708/nginx/0.log" Jun 02 20:40:47.082164 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:40:47.082135 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-6bg74_d0943bcd-e176-4098-8ee8-4cbdfcb8ff44/manager/0.log" Jun 02 20:40:47.211389 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:40:47.211355 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-5thrn_24518dce-ca06-4a8e-8830-01fdf956d529/manager/0.log" Jun 02 20:40:47.459910 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:40:47.459833 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29673870-94jl6_21bdb663-7c37-4115-a59c-cc3836edc2cc/cleanup/0.log" Jun 02 20:40:47.578710 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:40:47.578677 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bb676c484-nvfld_a8c5a5d1-60d8-4c32-888c-dcf006bf6cb9/manager/0.log" Jun 02 20:40:47.695319 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:40:47.695286 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-2jxzn_d561207b-1a89-4ac5-8ca6-ad0baa05d9bd/server/0.log" Jun 02 20:40:47.816942 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:40:47.816916 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-fm5jp_3c9dbfe0-5c73-4ffe-a4ff-707937c4346d/manager/0.log" Jun 02 20:40:47.929390 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:40:47.929360 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58b87b6c86-69ln7_c541706b-3e22-4792-8c03-8795c65e2abd/copy-manifests/0.log" Jun 02 20:40:47.943044 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:40:47.943017 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58b87b6c86-69ln7_c541706b-3e22-4792-8c03-8795c65e2abd/manager/0.log" Jun 02 20:40:48.299168 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:40:48.299087 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-d5t8p_18607ada-9989-4202-9eda-dbd8aac064f8/postgres/0.log" Jun 02 20:40:49.750210 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:40:49.750169 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-vr65f_4a729b96-675c-4b3b-b591-5377d7e74ce7/manager/0.log" Jun 02 20:40:50.962408 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:40:50.962371 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-mt7mh_e9c56487-fe97-4c9d-9a76-ec1ef13548fe/discovery/0.log" Jun 02 20:40:51.214976 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:40:51.214892 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78d7545c57-xt7fw_89b79022-e3c5-4382-a921-8b05591e084b/kube-auth-proxy/0.log" Jun 02 20:40:59.815226 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:40:59.815190 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dlshz_a1f2dc2a-48b4-4ba7-b8e1-75f572e70485/global-pull-secret-syncer/0.log" Jun 02 20:40:59.978616 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:40:59.978580 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pwg4k_2cfe96cc-8d38-4346-81ab-42172f429770/konnectivity-agent/0.log" Jun 02 20:41:00.037331 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:00.037303 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-46.ec2.internal_d2c4fe31db52904cda32b7bc3da196d3/haproxy/0.log" Jun 02 20:41:05.049619 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:05.049576 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-vr65f_4a729b96-675c-4b3b-b591-5377d7e74ce7/manager/0.log" Jun 02 20:41:07.529988 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:07.529954 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w84x6_41154016-7179-4eb5-9482-90f11a9ef100/node-exporter/0.log" Jun 02 20:41:07.553898 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:07.553870 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w84x6_41154016-7179-4eb5-9482-90f11a9ef100/kube-rbac-proxy/0.log" Jun 02 20:41:07.576684 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:07.576656 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w84x6_41154016-7179-4eb5-9482-90f11a9ef100/init-textfile/0.log" Jun 02 20:41:09.317925 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:09.317893 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-btpl5_b42cdcb3-9795-438c-9a98-8b3e4542f023/networking-console-plugin/0.log" Jun 02 20:41:10.661396 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.661357 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc"] Jun 02 20:41:10.661849 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.661818 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21bdb663-7c37-4115-a59c-cc3836edc2cc" containerName="cleanup" Jun 02 20:41:10.661849 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.661840 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="21bdb663-7c37-4115-a59c-cc3836edc2cc" containerName="cleanup" Jun 02 20:41:10.661971 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.661954 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="21bdb663-7c37-4115-a59c-cc3836edc2cc" containerName="cleanup" Jun 02 20:41:10.665100 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.665080 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:10.667658 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.667636 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fl6xc\"/\"openshift-service-ca.crt\"" Jun 02 20:41:10.667780 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.667682 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fl6xc\"/\"kube-root-ca.crt\"" Jun 02 20:41:10.667780 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.667696 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fl6xc\"/\"default-dockercfg-4c8mf\"" Jun 02 20:41:10.673107 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.673086 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc"] Jun 02 20:41:10.854038 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.853998 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b58dbb23-50fc-4d03-b077-b51bdd00501f-sys\") pod \"perf-node-gather-daemonset-glwpc\" (UID: \"b58dbb23-50fc-4d03-b077-b51bdd00501f\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:10.854230 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.854048 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b58dbb23-50fc-4d03-b077-b51bdd00501f-proc\") pod \"perf-node-gather-daemonset-glwpc\" (UID: \"b58dbb23-50fc-4d03-b077-b51bdd00501f\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:10.854230 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.854123 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b58dbb23-50fc-4d03-b077-b51bdd00501f-podres\") pod \"perf-node-gather-daemonset-glwpc\" (UID: \"b58dbb23-50fc-4d03-b077-b51bdd00501f\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:10.854230 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.854179 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b58dbb23-50fc-4d03-b077-b51bdd00501f-lib-modules\") pod \"perf-node-gather-daemonset-glwpc\" (UID: \"b58dbb23-50fc-4d03-b077-b51bdd00501f\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:10.854390 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.854295 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sz22\" (UniqueName: \"kubernetes.io/projected/b58dbb23-50fc-4d03-b077-b51bdd00501f-kube-api-access-9sz22\") pod \"perf-node-gather-daemonset-glwpc\" (UID: \"b58dbb23-50fc-4d03-b077-b51bdd00501f\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:10.954820 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.954726 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b58dbb23-50fc-4d03-b077-b51bdd00501f-sys\") pod \"perf-node-gather-daemonset-glwpc\" (UID: \"b58dbb23-50fc-4d03-b077-b51bdd00501f\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:10.954820 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.954774 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b58dbb23-50fc-4d03-b077-b51bdd00501f-proc\") pod \"perf-node-gather-daemonset-glwpc\" (UID: \"b58dbb23-50fc-4d03-b077-b51bdd00501f\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:10.954820 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.954803 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b58dbb23-50fc-4d03-b077-b51bdd00501f-podres\") pod \"perf-node-gather-daemonset-glwpc\" (UID: \"b58dbb23-50fc-4d03-b077-b51bdd00501f\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:10.955022 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.954829 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b58dbb23-50fc-4d03-b077-b51bdd00501f-lib-modules\") pod \"perf-node-gather-daemonset-glwpc\" (UID: \"b58dbb23-50fc-4d03-b077-b51bdd00501f\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:10.955022 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.954846 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b58dbb23-50fc-4d03-b077-b51bdd00501f-sys\") pod \"perf-node-gather-daemonset-glwpc\" (UID: \"b58dbb23-50fc-4d03-b077-b51bdd00501f\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:10.955022 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.954917 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b58dbb23-50fc-4d03-b077-b51bdd00501f-proc\") pod \"perf-node-gather-daemonset-glwpc\" (UID: \"b58dbb23-50fc-4d03-b077-b51bdd00501f\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:10.955022 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.954963 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b58dbb23-50fc-4d03-b077-b51bdd00501f-lib-modules\") pod \"perf-node-gather-daemonset-glwpc\" (UID: \"b58dbb23-50fc-4d03-b077-b51bdd00501f\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:10.955022 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.954963 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b58dbb23-50fc-4d03-b077-b51bdd00501f-podres\") pod \"perf-node-gather-daemonset-glwpc\" (UID: \"b58dbb23-50fc-4d03-b077-b51bdd00501f\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:10.955022 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.954920 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9sz22\" (UniqueName: \"kubernetes.io/projected/b58dbb23-50fc-4d03-b077-b51bdd00501f-kube-api-access-9sz22\") pod \"perf-node-gather-daemonset-glwpc\" (UID: \"b58dbb23-50fc-4d03-b077-b51bdd00501f\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:10.963302 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.963275 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sz22\" (UniqueName: \"kubernetes.io/projected/b58dbb23-50fc-4d03-b077-b51bdd00501f-kube-api-access-9sz22\") pod \"perf-node-gather-daemonset-glwpc\" (UID: \"b58dbb23-50fc-4d03-b077-b51bdd00501f\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:10.975099 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:10.975079 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:11.121021 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:11.120995 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc"] Jun 02 20:41:11.123577 ip-10-0-132-46 kubenswrapper[2562]: W0602 20:41:11.123546 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb58dbb23_50fc_4d03_b077_b51bdd00501f.slice/crio-dad70d481deb8e43ec0a5dec89d292ced603d5bf1309bba49f1202e4bb2c7034 WatchSource:0}: Error finding container dad70d481deb8e43ec0a5dec89d292ced603d5bf1309bba49f1202e4bb2c7034: Status 404 returned error can't find the container with id dad70d481deb8e43ec0a5dec89d292ced603d5bf1309bba49f1202e4bb2c7034 Jun 02 20:41:11.125367 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:11.125348 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 20:41:11.810630 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:11.810598 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4ggh2_dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5/dns/0.log" Jun 02 20:41:11.833111 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:11.833084 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4ggh2_dba65ee7-73d9-4a4b-893b-b7c8f9c6d1d5/kube-rbac-proxy/0.log" Jun 02 20:41:12.015262 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:12.015227 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" event={"ID":"b58dbb23-50fc-4d03-b077-b51bdd00501f","Type":"ContainerStarted","Data":"de94b78fb9b1354a9b90749d04410acba56c4fd219aa17bda724aed3c76208a8"} Jun 02 20:41:12.015262 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:12.015266 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" event={"ID":"b58dbb23-50fc-4d03-b077-b51bdd00501f","Type":"ContainerStarted","Data":"dad70d481deb8e43ec0a5dec89d292ced603d5bf1309bba49f1202e4bb2c7034"} Jun 02 20:41:12.015524 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:12.015358 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:12.016860 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:12.016837 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wc9fq_3550fef2-7bdf-4f39-b59b-38be4c78fc52/dns-node-resolver/0.log" Jun 02 20:41:12.034275 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:12.034230 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" podStartSLOduration=2.034214297 podStartE2EDuration="2.034214297s" podCreationTimestamp="2026-06-02 20:41:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:41:12.03230773 +0000 UTC m=+2366.877593700" watchObservedRunningTime="2026-06-02 20:41:12.034214297 +0000 UTC m=+2366.879500322" Jun 02 20:41:12.557842 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:12.557811 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vszcp_a92766b7-de27-4a9c-8ec8-f55cbc5b26b8/node-ca/0.log" Jun 02 20:41:13.519259 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:13.519224 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-mt7mh_e9c56487-fe97-4c9d-9a76-ec1ef13548fe/discovery/0.log" Jun 02 20:41:13.566985 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:13.566957 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78d7545c57-xt7fw_89b79022-e3c5-4382-a921-8b05591e084b/kube-auth-proxy/0.log" Jun 02 20:41:14.377726 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:14.377691 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zvshg_7f3e21f3-fbcd-45b6-b1b7-e84c88eaffab/serve-healthcheck-canary/0.log" Jun 02 20:41:15.021079 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:15.021050 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v8648_b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1/kube-rbac-proxy/0.log" Jun 02 20:41:15.045720 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:15.045693 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v8648_b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1/exporter/0.log" Jun 02 20:41:15.070972 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:15.070950 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v8648_b1aa6d34-6a97-4320-a37e-eeb5faa9e3b1/extractor/0.log" Jun 02 20:41:17.205003 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:17.204973 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-64d74bb8cd-44lft_12f4709e-971e-4074-9a86-5d5f7f1a8708/nginx/0.log" Jun 02 20:41:17.264658 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:17.264629 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-6bg74_d0943bcd-e176-4098-8ee8-4cbdfcb8ff44/manager/0.log" Jun 02 20:41:17.345093 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:17.345059 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-5thrn_24518dce-ca06-4a8e-8830-01fdf956d529/manager/0.log" Jun 02 20:41:17.400216 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:17.400180 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29673870-94jl6_21bdb663-7c37-4115-a59c-cc3836edc2cc/cleanup/0.log" Jun 02 20:41:17.472612 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:17.472536 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bb676c484-nvfld_a8c5a5d1-60d8-4c32-888c-dcf006bf6cb9/manager/0.log" Jun 02 20:41:17.496255 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:17.496234 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-2jxzn_d561207b-1a89-4ac5-8ca6-ad0baa05d9bd/server/0.log" Jun 02 20:41:17.541540 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:17.541509 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-fm5jp_3c9dbfe0-5c73-4ffe-a4ff-707937c4346d/manager/0.log" Jun 02 20:41:17.641416 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:17.641385 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58b87b6c86-69ln7_c541706b-3e22-4792-8c03-8795c65e2abd/manager/0.log" Jun 02 20:41:17.658923 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:17.658886 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58b87b6c86-69ln7_c541706b-3e22-4792-8c03-8795c65e2abd/copy-manifests/0.log" Jun 02 20:41:17.795986 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:17.795894 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-d5t8p_18607ada-9989-4202-9eda-dbd8aac064f8/postgres/0.log" Jun 02 20:41:18.029626 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:18.029601 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-glwpc" Jun 02 20:41:26.144487 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:26.144431 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlr5w_f1e99a4e-cb86-4060-a831-fb5113477814/kube-multus-additional-cni-plugins/0.log" Jun 02 20:41:26.166618 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:26.166592 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlr5w_f1e99a4e-cb86-4060-a831-fb5113477814/egress-router-binary-copy/0.log" Jun 02 20:41:26.188626 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:26.188598 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlr5w_f1e99a4e-cb86-4060-a831-fb5113477814/cni-plugins/0.log" Jun 02 20:41:26.234682 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:26.234651 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlr5w_f1e99a4e-cb86-4060-a831-fb5113477814/bond-cni-plugin/0.log" Jun 02 20:41:26.298588 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:26.298554 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlr5w_f1e99a4e-cb86-4060-a831-fb5113477814/routeoverride-cni/0.log" Jun 02 20:41:26.365801 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:26.365723 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlr5w_f1e99a4e-cb86-4060-a831-fb5113477814/whereabouts-cni-bincopy/0.log" Jun 02 20:41:26.435628 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:26.435604 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlr5w_f1e99a4e-cb86-4060-a831-fb5113477814/whereabouts-cni/0.log" Jun 02 20:41:26.669014 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:26.668913 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mfp9l_b927495c-7a28-4a3d-aa2d-4517632b4814/kube-multus/0.log" Jun 02 20:41:26.690923 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:26.690883 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dv4rg_b3b653aa-519a-48d7-8d68-f907db391e06/network-metrics-daemon/0.log" Jun 02 20:41:26.711665 ip-10-0-132-46 kubenswrapper[2562]: I0602 20:41:26.711635 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dv4rg_b3b653aa-519a-48d7-8d68-f907db391e06/kube-rbac-proxy/0.log"