Jul 02 16:35:46.243399 ip-10-0-134-249 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 16:35:46.243408 ip-10-0-134-249 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 16:35:46.243415 ip-10-0-134-249 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 16:35:46.243561 ip-10-0-134-249 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 16:35:56.283362 ip-10-0-134-249 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 16:35:56.283379 ip-10-0-134-249 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 92548da2bd994470a587fedc022caf1a -- Jul 02 16:37:58.561042 ip-10-0-134-249 systemd[1]: Starting Kubernetes Kubelet... Jul 02 16:38:00.387268 ip-10-0-134-249 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 16:38:00.387268 ip-10-0-134-249 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 16:38:00.387268 ip-10-0-134-249 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 16:38:00.387268 ip-10-0-134-249 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 16:38:00.387268 ip-10-0-134-249 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 16:38:00.389226 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.389103 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 16:38:00.396320 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396290 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:38:00.396320 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396315 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:38:00.396320 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396322 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:38:00.396320 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396328 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:38:00.396320 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396331 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396335 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396339 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396343 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396346 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396348 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396353 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396357 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396360 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396362 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396365 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396367 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396370 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396373 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396375 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396379 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396381 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396384 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396386 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:38:00.396568 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396389 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396392 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396394 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396397 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396399 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396402 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396404 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396407 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396410 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396412 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396415 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396418 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396420 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396422 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396425 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396429 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396432 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396434 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396437 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396439 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:38:00.396999 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396442 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396445 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396448 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396450 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396453 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396455 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396458 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396462 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396464 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396484 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396487 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396490 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396492 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396495 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396498 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396500 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396503 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396506 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396508 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:38:00.397533 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396511 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396513 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396516 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396519 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396522 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396524 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396527 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396530 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396534 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396537 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396540 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396542 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396545 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396548 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396550 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396553 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396555 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396558 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396561 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396564 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:38:00.397984 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396566 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396570 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396573 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396576 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396579 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396581 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396584 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396587 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396589 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396592 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396595 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396598 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396601 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396603 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396606 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396609 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.396611 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397397 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397404 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397408 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397412 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:38:00.398452 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397416 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397419 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397422 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397425 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397427 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397430 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397433 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397435 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397438 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397441 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397443 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397446 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397448 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397451 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397454 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397457 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397459 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397462 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397464 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397485 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:38:00.399097 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397489 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397492 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397494 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397499 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397503 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397507 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397509 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397513 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397516 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397519 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397522 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397524 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397527 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397530 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397532 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397535 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397538 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397541 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397544 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:38:00.399654 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397548 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397552 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397554 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397557 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397560 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397562 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397565 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397568 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397571 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397573 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397576 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397578 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397581 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397587 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397590 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397592 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397595 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397598 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397600 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397603 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:38:00.400116 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397605 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397608 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397611 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397614 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397618 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397620 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397623 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397626 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397628 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397631 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397634 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397636 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397639 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397642 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397644 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397647 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397649 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397652 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397655 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397657 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:38:00.400633 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397660 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397663 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397666 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397668 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397671 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397674 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397677 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397679 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397682 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397685 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397687 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397690 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397692 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397696 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397700 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.397703 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398128 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398134 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398137 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:38:00.401106 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398140 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398144 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398147 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398150 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398153 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398155 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398158 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398160 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398163 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398166 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398169 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398171 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398173 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398177 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398180 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398182 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398185 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398187 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398197 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:38:00.401592 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398200 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398203 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398207 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398210 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398213 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398216 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398219 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398222 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398224 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398227 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398230 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398232 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398235 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398238 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398240 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398242 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398245 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398248 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398250 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398253 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:38:00.402045 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398255 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398258 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398260 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398263 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398265 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398268 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398270 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398273 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398276 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398279 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398282 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398285 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398288 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398290 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398293 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398295 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398301 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398303 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398306 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398309 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:38:00.402553 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398312 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398314 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398316 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398319 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398322 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398325 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398328 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398330 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398333 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398335 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398338 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398340 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398343 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398347 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398350 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398352 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398355 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398357 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398360 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398362 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:38:00.403032 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398365 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398368 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398370 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398375 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398377 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398380 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398382 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398385 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398388 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398391 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398393 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398396 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398399 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398403 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398406 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398409 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.398412 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398511 2573 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398520 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398526 2573 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 16:38:00.403530 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398531 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398535 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398539 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398543 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398547 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398551 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398554 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398557 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398561 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398564 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398567 2573 flags.go:64] FLAG: --cgroup-root="" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398570 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398573 2573 flags.go:64] FLAG: --client-ca-file="" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398577 2573 flags.go:64] FLAG: --cloud-provider="external" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398580 2573 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398586 2573 flags.go:64] FLAG: --cluster-domain="" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398589 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398592 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398595 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398599 2573 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398604 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398607 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398610 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 16:38:00.404028 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398613 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398617 2573 flags.go:64] FLAG: --contention-profiling="false" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398620 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398623 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398626 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398629 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398633 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398636 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398639 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398642 2573 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398645 2573 flags.go:64] FLAG: --enable-server="true" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398648 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398652 2573 flags.go:64] FLAG: --event-burst="100" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398656 2573 flags.go:64] FLAG: --event-qps="50" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398659 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398662 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398665 2573 flags.go:64] FLAG: --eviction-hard="" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398669 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398672 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398674 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398678 2573 flags.go:64] FLAG: --eviction-soft="" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398681 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398683 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398687 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398690 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 16:38:00.404580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398693 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398696 2573 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398699 2573 flags.go:64] FLAG: --feature-gates="" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398703 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398708 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398711 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398714 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398718 2573 flags.go:64] FLAG: --healthz-port="10248" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398721 2573 flags.go:64] FLAG: --help="false" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398724 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-134-249.ec2.internal" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398727 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398730 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398733 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398736 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398739 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398742 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398745 2573 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398748 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398751 2573 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398754 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398757 2573 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398760 2573 flags.go:64] FLAG: --kube-reserved="" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398763 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398766 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 16:38:00.405273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398769 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398772 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398775 2573 flags.go:64] FLAG: --lock-file="" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398778 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398781 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398784 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398789 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398793 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398796 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398799 2573 flags.go:64] FLAG: --logging-format="text" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398802 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398805 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398809 2573 flags.go:64] FLAG: --manifest-url="" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398812 2573 flags.go:64] FLAG: --manifest-url-header="" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398817 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398819 2573 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398824 2573 flags.go:64] FLAG: --max-pods="110" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398827 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398830 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398832 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398835 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398838 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398841 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398844 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398853 2573 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 16:38:00.405883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398856 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398859 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398862 2573 flags.go:64] FLAG: --pod-cidr="" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398865 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398870 2573 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398874 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398877 2573 flags.go:64] FLAG: --pods-per-core="0" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398880 2573 flags.go:64] FLAG: --port="10250" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398883 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398886 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0032c2b87c5d70bb9" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398889 2573 flags.go:64] FLAG: --qos-reserved="" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398892 2573 flags.go:64] FLAG: --read-only-port="10255" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398895 2573 flags.go:64] FLAG: --register-node="true" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398898 2573 flags.go:64] FLAG: --register-with-taints="" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398902 2573 flags.go:64] FLAG: --registry-burst="10" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398905 2573 flags.go:64] FLAG: --registry-qps="5" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398908 2573 flags.go:64] FLAG: --reserved-cpus="" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398912 2573 flags.go:64] FLAG: --reserved-memory="" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398915 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398918 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398923 2573 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398925 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398928 2573 flags.go:64] FLAG: --runonce="false" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398931 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398934 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 16:38:00.406506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398937 2573 flags.go:64] FLAG: --seccomp-default="false" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398945 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398948 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398951 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398955 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398957 2573 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398960 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398963 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398966 2573 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398969 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398972 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398975 2573 flags.go:64] FLAG: --system-cgroups="" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398980 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398986 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398989 2573 flags.go:64] FLAG: --tls-cert-file="" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398992 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.398999 2573 flags.go:64] FLAG: --tls-min-version="" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.399002 2573 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.399005 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.399008 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.399011 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.399014 2573 flags.go:64] FLAG: --v="2" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.399018 2573 flags.go:64] FLAG: --version="false" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.399026 2573 flags.go:64] FLAG: --vmodule="" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.399030 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 16:38:00.407114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.399033 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399151 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399157 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399161 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399164 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399167 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399169 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399172 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399175 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399178 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399181 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399183 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399186 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399188 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399191 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399194 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399196 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399199 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399201 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399205 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:38:00.407721 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399208 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399211 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399213 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399216 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399218 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399221 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399223 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399226 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399229 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399231 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399234 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399237 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399240 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399242 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399246 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399249 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399252 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399254 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399257 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399260 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:38:00.408222 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399262 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399265 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399268 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399272 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399276 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399279 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399282 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399285 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399288 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399290 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399293 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399297 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399299 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399302 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399304 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399307 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399310 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399314 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399317 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:38:00.408769 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399319 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399322 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399324 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399327 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399330 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399332 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399335 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399339 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399342 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399344 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399347 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399349 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399352 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399355 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399357 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399360 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399362 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399365 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399368 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399370 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:38:00.409232 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399373 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399375 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399378 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399381 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399384 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399387 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399390 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399392 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399395 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399397 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399400 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399403 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399405 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399408 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399410 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399413 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399415 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399419 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399423 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399428 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:38:00.409718 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.399431 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:38:00.410192 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.400015 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 16:38:00.410192 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.406943 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 16:38:00.410192 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.406964 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 16:38:00.410192 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.407793 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 16:38:00.410192 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.407801 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 16:38:00.410192 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407862 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:38:00.410192 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407868 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:38:00.410192 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407871 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:38:00.410192 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407875 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:38:00.410192 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407879 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:38:00.410192 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407882 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:38:00.410192 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407886 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:38:00.410192 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407889 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:38:00.410192 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407892 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407895 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407898 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407901 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407904 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407906 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407909 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407912 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407914 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407917 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407920 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407922 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407925 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407927 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407930 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407933 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407935 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407938 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407941 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:38:00.410566 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407944 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407946 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407950 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407960 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407964 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407966 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407969 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407971 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407974 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407977 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407979 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407982 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407985 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407989 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407992 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.407996 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408001 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408004 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408007 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:38:00.411026 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408010 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408014 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408017 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408020 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408023 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408025 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408028 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408031 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408034 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408037 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408040 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408043 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408046 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408049 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408052 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408054 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408058 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408061 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408063 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408066 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:38:00.411610 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408069 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408072 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408074 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408077 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408079 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408082 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408084 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408087 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408090 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408092 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408095 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408097 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408100 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408102 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408105 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408108 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408110 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408113 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408115 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408118 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:38:00.412154 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408120 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:38:00.412672 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408123 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:38:00.412672 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408125 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:38:00.412672 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408128 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:38:00.412672 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408130 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:38:00.412672 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408133 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:38:00.412672 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408136 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:38:00.412672 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408139 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:38:00.412672 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408142 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:38:00.412672 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408144 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:38:00.412672 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408147 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:38:00.412672 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408150 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:38:00.412672 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408152 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:38:00.412672 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.408157 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 16:38:00.412672 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408274 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 16:38:00.412672 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408279 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408282 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408285 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408289 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408292 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408295 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408299 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408302 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408305 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408307 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408311 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408314 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408317 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408319 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408322 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408324 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408327 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408329 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408332 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 16:38:00.413047 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408335 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408337 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408340 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408343 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408346 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408348 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408351 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408353 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408356 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408359 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408362 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408364 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408367 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408369 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408372 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408375 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408377 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408380 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408382 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408385 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 16:38:00.413506 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408388 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408390 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408393 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408395 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408398 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408400 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408403 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408405 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408408 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408412 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408415 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408418 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408421 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408424 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408427 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408430 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408432 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408435 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408438 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408443 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 16:38:00.413985 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408446 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408448 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408451 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408453 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408456 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408459 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408461 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408464 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408480 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408482 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408485 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408487 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408490 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408492 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408495 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408498 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408501 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408503 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408506 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 16:38:00.414456 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408509 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408511 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408514 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408516 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408519 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408521 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408524 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408527 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408529 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408532 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408535 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408539 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408544 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408546 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408549 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408552 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408555 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408558 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408560 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 16:38:00.414933 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:00.408563 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 16:38:00.415387 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.408568 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 16:38:00.415387 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.408702 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 16:38:00.415387 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.410832 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 16:38:00.415387 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.412422 2573 server.go:1019] "Starting client certificate rotation" Jul 02 16:38:00.415387 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.412536 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 16:38:00.415387 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.412571 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 16:38:00.415758 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.415741 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 16:38:00.422496 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.422453 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 16:38:00.432243 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.432225 2573 log.go:25] "Validated CRI v1 runtime API" Jul 02 16:38:00.435985 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.435966 2573 log.go:25] "Validated CRI v1 image API" Jul 02 16:38:00.436751 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.436736 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 16:38:00.439180 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.439149 2573 fs.go:135] Filesystem UUIDs: map[767d9122-2c48-4bfc-99ee-eb67325de15c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8dd3ee4d-8b14-46ba-8fd9-d809fa848f1b:/dev/nvme0n1p3] Jul 02 16:38:00.439280 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.439177 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 16:38:00.442922 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.442899 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 16:38:00.444355 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.444232 2573 manager.go:216] Machine: {Timestamp:2026-07-02 16:38:00.442884606 +0000 UTC m=+0.359860123 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110862 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec253ca126f281cdee425f473a8a5b93 SystemUUID:ec253ca1-26f2-81cd-ee42-5f473a8a5b93 BootID:92548da2-bd99-4470-a587-fedc022caf1a Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f1:01:13:53:59 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f1:01:13:53:59 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:8d:e7:60:55:f2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 16:38:00.444355 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.444350 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 16:38:00.444543 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.444480 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 16:38:00.447877 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.447843 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 16:38:00.448031 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.447880 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-249.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 16:38:00.448693 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.448681 2573 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 16:38:00.448726 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.448695 2573 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 16:38:00.448726 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.448703 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 16:38:00.449486 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.449461 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 16:38:00.450394 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.450382 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 16:38:00.453623 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.453608 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 02 16:38:00.453767 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.453756 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 16:38:00.453800 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.453789 2573 kubelet.go:486] "Attempting to sync node with API server" Jul 02 16:38:00.453800 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.453799 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 16:38:00.453851 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.453814 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 16:38:00.453851 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.453824 2573 kubelet.go:398] "Adding apiserver pod source" Jul 02 16:38:00.453851 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.453835 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 16:38:00.454289 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.454276 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 16:38:00.454329 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.454299 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 16:38:00.456865 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.456841 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 16:38:00.458363 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.458348 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 16:38:00.458419 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.458380 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 16:38:00.459096 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.459080 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 16:38:00.459133 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.459105 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 16:38:00.459133 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.459113 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 16:38:00.459133 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.459119 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 16:38:00.459133 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.459128 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 16:38:00.459133 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.459134 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 16:38:00.459259 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.459143 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 16:38:00.459259 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.459148 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 16:38:00.459259 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.459159 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 16:38:00.459259 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.459169 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 16:38:00.459259 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.459179 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 16:38:00.459259 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.459185 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 16:38:00.460847 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.460835 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 16:38:00.460902 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.460849 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 16:38:00.465576 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.465551 2573 server.go:1268] "Started kubelet" Jul 02 16:38:00.465679 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.465599 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 16:38:00.465911 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:00.465885 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-249.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 16:38:00.466000 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.465955 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-249.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 16:38:00.466067 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.465968 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 16:38:00.466122 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.466080 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 16:38:00.466181 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:00.466157 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 16:38:00.466733 ip-10-0-134-249 systemd[1]: Started Kubernetes Kubelet. Jul 02 16:38:00.466862 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.466747 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4bl6j" Jul 02 16:38:00.468015 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.467997 2573 server.go:310] "Adding debug handlers to kubelet server" Jul 02 16:38:00.470264 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.470240 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 16:38:00.471991 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:00.471974 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 16:38:00.473747 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:00.472532 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-249.ec2.internal.18be86673e044280 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-249.ec2.internal,UID:ip-10-0-134-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-249.ec2.internal,},FirstTimestamp:2026-07-02 16:38:00.465515136 +0000 UTC m=+0.382490654,LastTimestamp:2026-07-02 16:38:00.465515136 +0000 UTC m=+0.382490654,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-249.ec2.internal,}" Jul 02 16:38:00.476107 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.476092 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 16:38:00.476162 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.476105 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 16:38:00.476208 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:00.476190 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-249.ec2.internal\" not found" Jul 02 16:38:00.476689 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.476662 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 16:38:00.476851 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.476749 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 16:38:00.476851 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.476764 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 16:38:00.476942 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.476876 2573 reconstruct.go:97] "Volume reconstruction finished" Jul 02 16:38:00.476942 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.476905 2573 reconciler.go:29] "Reconciler: start to sync state" Jul 02 16:38:00.477052 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.477019 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4bl6j" Jul 02 16:38:00.477198 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.477169 2573 factory.go:55] Registering systemd factory Jul 02 16:38:00.477198 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.477189 2573 factory.go:223] Registration of the systemd container factory successfully Jul 02 16:38:00.477448 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.477433 2573 factory.go:153] Registering CRI-O factory Jul 02 16:38:00.477516 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.477453 2573 factory.go:223] Registration of the crio container factory successfully Jul 02 16:38:00.477559 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.477517 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 16:38:00.477559 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.477547 2573 factory.go:103] Registering Raw factory Jul 02 16:38:00.477658 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.477565 2573 manager.go:1196] Started watching for new ooms in manager Jul 02 16:38:00.478005 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.477959 2573 manager.go:349] Starting recovery of all containers Jul 02 16:38:00.487646 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.487586 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:38:00.488849 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.488834 2573 manager.go:354] Recovery completed Jul 02 16:38:00.489980 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:00.489946 2573 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-249.ec2.internal\" not found" node="ip-10-0-134-249.ec2.internal" Jul 02 16:38:00.493745 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.493732 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:38:00.497966 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.497945 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:38:00.498067 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.497974 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:38:00.498067 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.497985 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:38:00.498597 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.498580 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 16:38:00.498684 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.498598 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 16:38:00.498684 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.498613 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:38:00.498684 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.498620 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 02 16:38:00.499430 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.499414 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:38:00.499514 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.499441 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:38:00.499514 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.499451 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:38:00.499790 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.499779 2573 policy_none.go:49] "None policy: Start" Jul 02 16:38:00.499820 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.499795 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 16:38:00.499820 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.499807 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 16:38:00.500725 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.500714 2573 policy_none.go:47] "Start" Jul 02 16:38:00.537350 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.537147 2573 manager.go:337] "Starting Device Plugin manager" Jul 02 16:38:00.552868 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:00.537379 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 16:38:00.552868 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.537392 2573 server.go:87] "Starting device plugin registration server" Jul 02 16:38:00.552868 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.537787 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 16:38:00.552868 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.537804 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 16:38:00.552868 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.537999 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 16:38:00.552868 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.538096 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 16:38:00.552868 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.538105 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 16:38:00.552868 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:00.538672 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 16:38:00.552868 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:00.538747 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-249.ec2.internal\" not found" Jul 02 16:38:00.552868 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.547784 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 16:38:00.552868 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.548918 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 16:38:00.552868 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.548952 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 16:38:00.552868 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.548971 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 16:38:00.552868 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:00.549001 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 16:38:00.552868 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.550999 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:38:00.639196 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.639149 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:38:00.640236 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.640218 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:38:00.640336 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.640250 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:38:00.640336 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.640259 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:38:00.640336 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.640283 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-249.ec2.internal" Jul 02 16:38:00.648349 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.648332 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-249.ec2.internal" Jul 02 16:38:00.648423 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:00.648361 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-249.ec2.internal\": node \"ip-10-0-134-249.ec2.internal\" not found" Jul 02 16:38:00.649486 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.649446 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-249.ec2.internal"] Jul 02 16:38:00.649543 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.649533 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:38:00.650940 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.650920 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:38:00.651058 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.650948 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:38:00.651058 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.650959 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:38:00.652273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.652260 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:38:00.652398 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.652384 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal" Jul 02 16:38:00.652436 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.652416 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:38:00.652986 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.652970 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:38:00.653059 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.652998 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:38:00.653059 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.653007 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:38:00.653446 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.653431 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:38:00.653517 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.653461 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:38:00.653517 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.653492 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:38:00.654269 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.654256 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-249.ec2.internal" Jul 02 16:38:00.654315 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.654302 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 16:38:00.654948 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.654933 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasSufficientMemory" Jul 02 16:38:00.655032 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.654956 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 16:38:00.655032 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.654968 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeHasSufficientPID" Jul 02 16:38:00.658294 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:00.658274 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-249.ec2.internal\" not found" Jul 02 16:38:00.678595 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.678568 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/339e53908043e400474ae006b0043081-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal\" (UID: \"339e53908043e400474ae006b0043081\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal" Jul 02 16:38:00.678595 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.678598 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/339e53908043e400474ae006b0043081-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal\" (UID: \"339e53908043e400474ae006b0043081\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal" Jul 02 16:38:00.678801 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.678618 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a77a55fac5f1e674526bbab8b6258dc4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-249.ec2.internal\" (UID: \"a77a55fac5f1e674526bbab8b6258dc4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-249.ec2.internal" Jul 02 16:38:00.687278 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:00.687258 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-249.ec2.internal\" not found" node="ip-10-0-134-249.ec2.internal" Jul 02 16:38:00.691611 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:00.691593 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-249.ec2.internal\" not found" node="ip-10-0-134-249.ec2.internal" Jul 02 16:38:00.759326 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:00.759239 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-249.ec2.internal\" not found" Jul 02 16:38:00.779720 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.779691 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/339e53908043e400474ae006b0043081-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal\" (UID: \"339e53908043e400474ae006b0043081\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal" Jul 02 16:38:00.779866 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.779721 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/339e53908043e400474ae006b0043081-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal\" (UID: \"339e53908043e400474ae006b0043081\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal" Jul 02 16:38:00.779866 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.779742 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a77a55fac5f1e674526bbab8b6258dc4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-249.ec2.internal\" (UID: \"a77a55fac5f1e674526bbab8b6258dc4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-249.ec2.internal" Jul 02 16:38:00.779866 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.779784 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a77a55fac5f1e674526bbab8b6258dc4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-249.ec2.internal\" (UID: \"a77a55fac5f1e674526bbab8b6258dc4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-249.ec2.internal" Jul 02 16:38:00.779866 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.779808 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/339e53908043e400474ae006b0043081-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal\" (UID: \"339e53908043e400474ae006b0043081\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal" Jul 02 16:38:00.779866 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.779811 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/339e53908043e400474ae006b0043081-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal\" (UID: \"339e53908043e400474ae006b0043081\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal" Jul 02 16:38:00.859424 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:00.859377 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-249.ec2.internal\" not found" Jul 02 16:38:00.960260 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:00.960217 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-249.ec2.internal\" not found" Jul 02 16:38:00.990783 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.990753 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal" Jul 02 16:38:00.995035 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:00.995018 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-249.ec2.internal" Jul 02 16:38:01.061189 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:01.061098 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-249.ec2.internal\" not found" Jul 02 16:38:01.161626 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:01.161594 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-249.ec2.internal\" not found" Jul 02 16:38:01.262122 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:01.262087 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-249.ec2.internal\" not found" Jul 02 16:38:01.346165 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.346090 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:38:01.376402 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.376372 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal" Jul 02 16:38:01.387143 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.387119 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 16:38:01.388985 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.388970 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-249.ec2.internal" Jul 02 16:38:01.397036 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.397012 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 16:38:01.412137 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.412111 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 16:38:01.412311 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.412291 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 16:38:01.412381 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.412309 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 16:38:01.412381 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.412310 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 16:38:01.454441 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.454411 2573 apiserver.go:52] "Watching apiserver" Jul 02 16:38:01.468342 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.468313 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 16:38:01.468733 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.468708 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-s6vg5","kube-system/konnectivity-agent-7575b","kube-system/kube-apiserver-proxy-ip-10-0-134-249.ec2.internal","openshift-dns/node-resolver-djv7s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal","openshift-multus/multus-5v4fr","openshift-multus/multus-additional-cni-plugins-zlxgn","openshift-ovn-kubernetes/ovnkube-node-w9jrc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52","openshift-cluster-node-tuning-operator/tuned-gjc8m","openshift-image-registry/node-ca-6hb5p","openshift-multus/network-metrics-daemon-nxkt7","openshift-network-diagnostics/network-check-target-qq7d5","openshift-network-operator/iptables-alerter-kr5gx"] Jul 02 16:38:01.470175 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.470153 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.472638 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.472100 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6hb5p" Jul 02 16:38:01.473756 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.473590 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 16:38:01.473756 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.473601 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 16:38:01.473756 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.473591 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 16:38:01.473756 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.473691 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ff2dw\"" Jul 02 16:38:01.473756 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.473603 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 16:38:01.473756 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.473727 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kr5gx" Jul 02 16:38:01.473756 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.473590 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 16:38:01.474753 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.474647 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 16:38:01.474753 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.474664 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 16:38:01.474753 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.474711 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 16:38:01.474962 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.474833 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gkrjg\"" Jul 02 16:38:01.474962 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.474898 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-djv7s" Jul 02 16:38:01.475908 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.475883 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 16:38:01.476042 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.476011 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 16:38:01.476151 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.476114 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pq7st\"" Jul 02 16:38:01.476211 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.476181 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 16:38:01.476211 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.476201 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.476302 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.476290 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 16:38:01.477232 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.477050 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 16:38:01.477232 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.477070 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kw8zv\"" Jul 02 16:38:01.477232 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.477098 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 16:38:01.477232 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.477172 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.478422 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.478405 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 16:38:01.478533 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.478518 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 16:38:01.478606 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.478577 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 16:38:01.478606 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.478599 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 16:38:01.478900 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.478886 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.479677 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.479659 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 16:38:01.479771 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.479684 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7ddjr\"" Jul 02 16:38:01.479771 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.479659 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 16:38:01.479933 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.479914 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 16:38:01.480114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.480102 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:01.480175 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:01.480157 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq7d5" podUID="3717aa36-be52-423e-ab4d-292c1785b1b4" Jul 02 16:38:01.480279 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.480265 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5w76j\"" Jul 02 16:38:01.480817 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.480803 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 16:38:01.481106 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.481092 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 16:38:01.481334 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.481321 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7575b" Jul 02 16:38:01.481456 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.481434 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:38:01.481704 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.481685 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 16:38:01.481780 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.481727 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g64zg\"" Jul 02 16:38:01.481913 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.481856 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 16:33:00 +0000 UTC" deadline="2028-03-08 18:40:07.79225913 +0000 UTC" Jul 02 16:38:01.481913 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.481905 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14762h2m6.310359481s" Jul 02 16:38:01.483127 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.483106 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.483696 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.483675 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 16:38:01.483861 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.483836 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 16:38:01.484542 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.484523 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9wl5w\"" Jul 02 16:38:01.484799 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.484755 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx94t\" (UniqueName: \"kubernetes.io/projected/a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c-kube-api-access-zx94t\") pod \"node-resolver-djv7s\" (UID: \"a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c\") " pod="openshift-dns/node-resolver-djv7s" Jul 02 16:38:01.485165 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.485147 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:01.485687 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:01.485663 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6vg5" podUID="c53fa6ea-2dd2-4c30-b86f-f6a9eca60083" Jul 02 16:38:01.485775 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.485275 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r4wq2\"" Jul 02 16:38:01.485991 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.485148 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.486221 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.486100 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-host-var-lib-kubelet\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.486288 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.486233 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df8ac230-f7d1-418a-b4a0-6318f84ca274-host-slash\") pod \"iptables-alerter-kr5gx\" (UID: \"df8ac230-f7d1-418a-b4a0-6318f84ca274\") " pod="openshift-network-operator/iptables-alerter-kr5gx" Jul 02 16:38:01.486288 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.486270 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-cni-bin\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.486378 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.486291 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-host-run-multus-certs\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.486378 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.486335 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bst4h\" (UniqueName: \"kubernetes.io/projected/df8ac230-f7d1-418a-b4a0-6318f84ca274-kube-api-access-bst4h\") pod \"iptables-alerter-kr5gx\" (UID: \"df8ac230-f7d1-418a-b4a0-6318f84ca274\") " pod="openshift-network-operator/iptables-alerter-kr5gx" Jul 02 16:38:01.486378 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.486358 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-system-cni-dir\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.486634 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.486377 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c-hosts-file\") pod \"node-resolver-djv7s\" (UID: \"a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c\") " pod="openshift-dns/node-resolver-djv7s" Jul 02 16:38:01.486634 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.486563 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-kubelet\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.486634 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.486611 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-multus-conf-dir\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.486768 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.486654 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/156cb232-e7c6-4352-b91f-26673a603734-cni-binary-copy\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.486768 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.486690 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-log-socket\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.486853 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.486764 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-host-run-netns\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.486897 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.486858 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-var-lib-openvswitch\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.486940 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.486881 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-run-ovn\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.486940 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.486919 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56c62a91-75b9-497f-8114-278f6da1fcce-ovnkube-config\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.487022 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.486955 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-multus-socket-dir-parent\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.487022 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.486973 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86g2z\" (UniqueName: \"kubernetes.io/projected/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-kube-api-access-86g2z\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.487108 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.487087 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf010754-1ca0-4088-82fe-281768fbea72-serviceca\") pod \"node-ca-6hb5p\" (UID: \"cf010754-1ca0-4088-82fe-281768fbea72\") " pod="openshift-image-registry/node-ca-6hb5p" Jul 02 16:38:01.487148 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.487132 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-node-log\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.487190 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.487152 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-cnibin\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.487190 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.487179 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/156cb232-e7c6-4352-b91f-26673a603734-system-cni-dir\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.487276 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.487205 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxr6x\" (UniqueName: \"kubernetes.io/projected/56c62a91-75b9-497f-8114-278f6da1fcce-kube-api-access-sxr6x\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.487319 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.487293 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-host-var-lib-cni-bin\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.487446 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.487434 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-multus-daemon-config\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.487504 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.487463 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/156cb232-e7c6-4352-b91f-26673a603734-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.487553 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.487506 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-systemd-units\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.487553 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.487523 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-run-systemd\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.487640 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.487546 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-run-openvswitch\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.487640 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.487570 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-run-ovn-kubernetes\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.487757 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.487740 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-etc-kubernetes\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.487799 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.487768 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/156cb232-e7c6-4352-b91f-26673a603734-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.487846 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.487787 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpl2g\" (UniqueName: \"kubernetes.io/projected/cf010754-1ca0-4088-82fe-281768fbea72-kube-api-access-wpl2g\") pod \"node-ca-6hb5p\" (UID: \"cf010754-1ca0-4088-82fe-281768fbea72\") " pod="openshift-image-registry/node-ca-6hb5p" Jul 02 16:38:01.487846 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.487816 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-etc-openvswitch\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.487846 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.487834 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56c62a91-75b9-497f-8114-278f6da1fcce-env-overrides\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.488036 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488023 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-os-release\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.488084 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488067 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-hostroot\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.488127 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488087 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/156cb232-e7c6-4352-b91f-26673a603734-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.488127 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488111 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf010754-1ca0-4088-82fe-281768fbea72-host\") pod \"node-ca-6hb5p\" (UID: \"cf010754-1ca0-4088-82fe-281768fbea72\") " pod="openshift-image-registry/node-ca-6hb5p" Jul 02 16:38:01.488289 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488181 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df8ac230-f7d1-418a-b4a0-6318f84ca274-iptables-alerter-script\") pod \"iptables-alerter-kr5gx\" (UID: \"df8ac230-f7d1-418a-b4a0-6318f84ca274\") " pod="openshift-network-operator/iptables-alerter-kr5gx" Jul 02 16:38:01.488289 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488200 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-cni-netd\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.488289 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488264 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56c62a91-75b9-497f-8114-278f6da1fcce-ovnkube-script-lib\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.488289 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488283 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c-tmp-dir\") pod \"node-resolver-djv7s\" (UID: \"a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c\") " pod="openshift-dns/node-resolver-djv7s" Jul 02 16:38:01.488462 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488310 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-run-netns\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.488462 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488335 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56c62a91-75b9-497f-8114-278f6da1fcce-ovn-node-metrics-cert\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.488462 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488369 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-multus-cni-dir\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.488462 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488387 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/156cb232-e7c6-4352-b91f-26673a603734-cnibin\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.488657 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488597 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/156cb232-e7c6-4352-b91f-26673a603734-os-release\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.488707 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488632 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vz2t\" (UniqueName: \"kubernetes.io/projected/156cb232-e7c6-4352-b91f-26673a603734-kube-api-access-7vz2t\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.488756 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488719 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-slash\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.488802 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488762 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-cni-binary-copy\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.489059 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488804 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-host-run-k8s-cni-cncf-io\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.489059 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488837 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-host-var-lib-cni-multus\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.489059 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.488897 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 16:38:01.489059 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.485374 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 16:38:01.489345 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.489325 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 16:38:01.490198 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.490178 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:01.490499 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:01.490294 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:38:01.509831 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.509808 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4ccdf" Jul 02 16:38:01.522427 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.522403 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4ccdf" Jul 02 16:38:01.549687 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:01.549635 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod339e53908043e400474ae006b0043081.slice/crio-a796598d95a2fe65cec8a19db5abd3d0f2b62dcdb789404b89f69259b7bca4ff WatchSource:0}: Error finding container a796598d95a2fe65cec8a19db5abd3d0f2b62dcdb789404b89f69259b7bca4ff: Status 404 returned error can't find the container with id a796598d95a2fe65cec8a19db5abd3d0f2b62dcdb789404b89f69259b7bca4ff Jul 02 16:38:01.550130 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:01.550096 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77a55fac5f1e674526bbab8b6258dc4.slice/crio-0bc729730e90b0e72717b480540e7ae1be90a1a33d60a3ca1474ab890be1c2d5 WatchSource:0}: Error finding container 0bc729730e90b0e72717b480540e7ae1be90a1a33d60a3ca1474ab890be1c2d5: Status 404 returned error can't find the container with id 0bc729730e90b0e72717b480540e7ae1be90a1a33d60a3ca1474ab890be1c2d5 Jul 02 16:38:01.554944 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.554927 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 16:38:01.578083 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.578059 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 16:38:01.589765 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.589740 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-multus-socket-dir-parent\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.589863 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.589767 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86g2z\" (UniqueName: \"kubernetes.io/projected/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-kube-api-access-86g2z\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.589863 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.589784 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf010754-1ca0-4088-82fe-281768fbea72-serviceca\") pod \"node-ca-6hb5p\" (UID: \"cf010754-1ca0-4088-82fe-281768fbea72\") " pod="openshift-image-registry/node-ca-6hb5p" Jul 02 16:38:01.589863 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.589803 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-sysconfig\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.589863 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.589826 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-node-log\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.589863 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.589841 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-cnibin\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.589863 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.589860 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/156cb232-e7c6-4352-b91f-26673a603734-system-cni-dir\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.590143 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.589887 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-sysctl-d\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.590143 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.589931 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-run\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.590143 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.589950 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-cnibin\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.590143 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.589953 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-multus-socket-dir-parent\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.590143 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.589959 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs\") pod \"network-metrics-daemon-nxkt7\" (UID: \"89ea8114-cf19-48eb-a43f-1ea418757a27\") " pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:01.590143 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590015 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz9mc\" (UniqueName: \"kubernetes.io/projected/d24254f4-7e70-4cce-9d46-282a3277589d-kube-api-access-vz9mc\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.590143 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590033 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-node-log\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.590143 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590016 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/156cb232-e7c6-4352-b91f-26673a603734-system-cni-dir\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.590143 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590046 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76cf1749-1a4a-46b2-82a8-1d70fd022f0e-konnectivity-ca\") pod \"konnectivity-agent-7575b\" (UID: \"76cf1749-1a4a-46b2-82a8-1d70fd022f0e\") " pod="kube-system/konnectivity-agent-7575b" Jul 02 16:38:01.590143 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590093 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxr6x\" (UniqueName: \"kubernetes.io/projected/56c62a91-75b9-497f-8114-278f6da1fcce-kube-api-access-sxr6x\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.590143 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590118 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-host-var-lib-cni-bin\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.590719 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590157 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-host-var-lib-cni-bin\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.590719 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590237 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-multus-daemon-config\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.590719 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590280 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/156cb232-e7c6-4352-b91f-26673a603734-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.590719 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590329 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-sys\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.590719 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590446 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d24254f4-7e70-4cce-9d46-282a3277589d-etc-selinux\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.590719 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590435 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf010754-1ca0-4088-82fe-281768fbea72-serviceca\") pod \"node-ca-6hb5p\" (UID: \"cf010754-1ca0-4088-82fe-281768fbea72\") " pod="openshift-image-registry/node-ca-6hb5p" Jul 02 16:38:01.590719 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590494 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-dbus\") pod \"global-pull-secret-syncer-s6vg5\" (UID: \"c53fa6ea-2dd2-4c30-b86f-f6a9eca60083\") " pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:01.590719 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590568 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-systemd-units\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.590719 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590590 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-run-systemd\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.590719 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590605 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-run-openvswitch\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.590719 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590620 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-run-ovn-kubernetes\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.590719 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590634 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-etc-kubernetes\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.590719 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590624 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-systemd-units\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.590719 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590680 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/156cb232-e7c6-4352-b91f-26673a603734-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.590719 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590712 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-run-openvswitch\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.591341 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590743 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-etc-kubernetes\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.591341 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590726 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-run-ovn-kubernetes\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.591341 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590712 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpl2g\" (UniqueName: \"kubernetes.io/projected/cf010754-1ca0-4088-82fe-281768fbea72-kube-api-access-wpl2g\") pod \"node-ca-6hb5p\" (UID: \"cf010754-1ca0-4088-82fe-281768fbea72\") " pod="openshift-image-registry/node-ca-6hb5p" Jul 02 16:38:01.591341 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590786 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-sysctl-conf\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.591341 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590804 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-etc-openvswitch\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.591341 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590733 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-run-systemd\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.591341 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590869 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56c62a91-75b9-497f-8114-278f6da1fcce-env-overrides\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.591341 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590894 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-os-release\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.591341 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590893 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-etc-openvswitch\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.591341 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590970 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-hostroot\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.591341 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.590999 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/156cb232-e7c6-4352-b91f-26673a603734-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.591341 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591037 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/156cb232-e7c6-4352-b91f-26673a603734-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.591341 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591053 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-modprobe-d\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.591341 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591077 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-kubernetes\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.591341 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591125 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-systemd\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.591341 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591120 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-os-release\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.591341 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591153 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf010754-1ca0-4088-82fe-281768fbea72-host\") pod \"node-ca-6hb5p\" (UID: \"cf010754-1ca0-4088-82fe-281768fbea72\") " pod="openshift-image-registry/node-ca-6hb5p" Jul 02 16:38:01.592104 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591176 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-hostroot\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.592104 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591231 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf010754-1ca0-4088-82fe-281768fbea72-host\") pod \"node-ca-6hb5p\" (UID: \"cf010754-1ca0-4088-82fe-281768fbea72\") " pod="openshift-image-registry/node-ca-6hb5p" Jul 02 16:38:01.592104 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591244 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/156cb232-e7c6-4352-b91f-26673a603734-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.592104 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591282 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/156cb232-e7c6-4352-b91f-26673a603734-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.592104 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591301 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df8ac230-f7d1-418a-b4a0-6318f84ca274-iptables-alerter-script\") pod \"iptables-alerter-kr5gx\" (UID: \"df8ac230-f7d1-418a-b4a0-6318f84ca274\") " pod="openshift-network-operator/iptables-alerter-kr5gx" Jul 02 16:38:01.592104 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591354 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-cni-netd\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.592104 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591386 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56c62a91-75b9-497f-8114-278f6da1fcce-ovnkube-script-lib\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.592104 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591424 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-cni-netd\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.592104 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591420 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-kubelet-config\") pod \"global-pull-secret-syncer-s6vg5\" (UID: \"c53fa6ea-2dd2-4c30-b86f-f6a9eca60083\") " pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:01.592104 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591388 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-multus-daemon-config\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.592104 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591436 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56c62a91-75b9-497f-8114-278f6da1fcce-env-overrides\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.592104 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591458 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c-tmp-dir\") pod \"node-resolver-djv7s\" (UID: \"a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c\") " pod="openshift-dns/node-resolver-djv7s" Jul 02 16:38:01.592104 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591532 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-run-netns\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.592104 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591575 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56c62a91-75b9-497f-8114-278f6da1fcce-ovn-node-metrics-cert\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.592104 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591598 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-multus-cni-dir\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.592104 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591599 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-run-netns\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.592104 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591632 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/156cb232-e7c6-4352-b91f-26673a603734-cnibin\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.592888 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591656 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/156cb232-e7c6-4352-b91f-26673a603734-os-release\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.592888 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591684 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vz2t\" (UniqueName: \"kubernetes.io/projected/156cb232-e7c6-4352-b91f-26673a603734-kube-api-access-7vz2t\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.592888 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591717 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6005b159-6ea6-4bd2-9e3a-357e951af2c1-tmp\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.592888 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591744 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-slash\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.592888 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591767 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-cni-binary-copy\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.592888 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591795 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-host-run-k8s-cni-cncf-io\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.592888 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591783 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-multus-cni-dir\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.592888 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591819 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d24254f4-7e70-4cce-9d46-282a3277589d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.592888 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591869 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/156cb232-e7c6-4352-b91f-26673a603734-cnibin\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.592888 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591873 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d24254f4-7e70-4cce-9d46-282a3277589d-sys-fs\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.592888 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591920 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-host-var-lib-cni-multus\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.592888 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591946 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx94t\" (UniqueName: \"kubernetes.io/projected/a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c-kube-api-access-zx94t\") pod \"node-resolver-djv7s\" (UID: \"a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c\") " pod="openshift-dns/node-resolver-djv7s" Jul 02 16:38:01.592888 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591998 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.592888 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592047 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-host-var-lib-kubelet\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.592888 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592030 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df8ac230-f7d1-418a-b4a0-6318f84ca274-iptables-alerter-script\") pod \"iptables-alerter-kr5gx\" (UID: \"df8ac230-f7d1-418a-b4a0-6318f84ca274\") " pod="openshift-network-operator/iptables-alerter-kr5gx" Jul 02 16:38:01.592888 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592071 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df8ac230-f7d1-418a-b4a0-6318f84ca274-host-slash\") pod \"iptables-alerter-kr5gx\" (UID: \"df8ac230-f7d1-418a-b4a0-6318f84ca274\") " pod="openshift-network-operator/iptables-alerter-kr5gx" Jul 02 16:38:01.592888 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592097 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c724b\" (UniqueName: \"kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b\") pod \"network-check-target-qq7d5\" (UID: \"3717aa36-be52-423e-ab4d-292c1785b1b4\") " pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:01.593447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.591682 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c-tmp-dir\") pod \"node-resolver-djv7s\" (UID: \"a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c\") " pod="openshift-dns/node-resolver-djv7s" Jul 02 16:38:01.593447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592120 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-slash\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.593447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592181 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/156cb232-e7c6-4352-b91f-26673a603734-os-release\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.593447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592198 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-host-run-k8s-cni-cncf-io\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.593447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592192 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.593447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592121 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76cf1749-1a4a-46b2-82a8-1d70fd022f0e-agent-certs\") pod \"konnectivity-agent-7575b\" (UID: \"76cf1749-1a4a-46b2-82a8-1d70fd022f0e\") " pod="kube-system/konnectivity-agent-7575b" Jul 02 16:38:01.593447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592253 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-cni-bin\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.593447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592254 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56c62a91-75b9-497f-8114-278f6da1fcce-ovnkube-script-lib\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.593447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592279 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-tuned\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.593447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592274 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df8ac230-f7d1-418a-b4a0-6318f84ca274-host-slash\") pod \"iptables-alerter-kr5gx\" (UID: \"df8ac230-f7d1-418a-b4a0-6318f84ca274\") " pod="openshift-network-operator/iptables-alerter-kr5gx" Jul 02 16:38:01.593447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592297 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-host-var-lib-kubelet\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.593447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592338 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-host-var-lib-cni-multus\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.593447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592347 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-lib-modules\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.593447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592401 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-cni-bin\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.593447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592404 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbznc\" (UniqueName: \"kubernetes.io/projected/6005b159-6ea6-4bd2-9e3a-357e951af2c1-kube-api-access-tbznc\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.593447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592432 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d24254f4-7e70-4cce-9d46-282a3277589d-device-dir\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.593447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592460 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-host-run-multus-certs\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.593964 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592512 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bst4h\" (UniqueName: \"kubernetes.io/projected/df8ac230-f7d1-418a-b4a0-6318f84ca274-kube-api-access-bst4h\") pod \"iptables-alerter-kr5gx\" (UID: \"df8ac230-f7d1-418a-b4a0-6318f84ca274\") " pod="openshift-network-operator/iptables-alerter-kr5gx" Jul 02 16:38:01.593964 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592533 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-cni-binary-copy\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.593964 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592541 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-system-cni-dir\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.593964 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592528 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-host-run-multus-certs\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.593964 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592594 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-system-cni-dir\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.593964 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592617 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c-hosts-file\") pod \"node-resolver-djv7s\" (UID: \"a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c\") " pod="openshift-dns/node-resolver-djv7s" Jul 02 16:38:01.593964 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592656 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-kubelet\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.593964 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592678 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-multus-conf-dir\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.593964 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592693 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/156cb232-e7c6-4352-b91f-26673a603734-cni-binary-copy\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.593964 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592714 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-host-kubelet\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.593964 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592747 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-multus-conf-dir\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.593964 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592699 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c-hosts-file\") pod \"node-resolver-djv7s\" (UID: \"a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c\") " pod="openshift-dns/node-resolver-djv7s" Jul 02 16:38:01.593964 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592767 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-host\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.593964 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592744 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 16:38:01.593964 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592793 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mthjc\" (UniqueName: \"kubernetes.io/projected/89ea8114-cf19-48eb-a43f-1ea418757a27-kube-api-access-mthjc\") pod \"network-metrics-daemon-nxkt7\" (UID: \"89ea8114-cf19-48eb-a43f-1ea418757a27\") " pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:01.593964 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592818 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d24254f4-7e70-4cce-9d46-282a3277589d-socket-dir\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.593964 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592863 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-var-lib-kubelet\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.593964 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592949 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d24254f4-7e70-4cce-9d46-282a3277589d-registration-dir\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.594456 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592970 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-log-socket\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.594456 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.592992 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-host-run-netns\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.594456 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.593007 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret\") pod \"global-pull-secret-syncer-s6vg5\" (UID: \"c53fa6ea-2dd2-4c30-b86f-f6a9eca60083\") " pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:01.594456 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.593038 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-log-socket\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.594456 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.593053 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-host-run-netns\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.594456 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.593074 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-var-lib-openvswitch\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.594456 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.593089 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-run-ovn\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.594456 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.593099 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/156cb232-e7c6-4352-b91f-26673a603734-cni-binary-copy\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.594456 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.593108 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56c62a91-75b9-497f-8114-278f6da1fcce-ovnkube-config\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.594456 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.593120 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-var-lib-openvswitch\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.594456 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.593133 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56c62a91-75b9-497f-8114-278f6da1fcce-run-ovn\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.594456 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.593515 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56c62a91-75b9-497f-8114-278f6da1fcce-ovnkube-config\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.596058 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.596038 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56c62a91-75b9-497f-8114-278f6da1fcce-ovn-node-metrics-cert\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.601280 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.601220 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx94t\" (UniqueName: \"kubernetes.io/projected/a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c-kube-api-access-zx94t\") pod \"node-resolver-djv7s\" (UID: \"a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c\") " pod="openshift-dns/node-resolver-djv7s" Jul 02 16:38:01.601380 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.601319 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpl2g\" (UniqueName: \"kubernetes.io/projected/cf010754-1ca0-4088-82fe-281768fbea72-kube-api-access-wpl2g\") pod \"node-ca-6hb5p\" (UID: \"cf010754-1ca0-4088-82fe-281768fbea72\") " pod="openshift-image-registry/node-ca-6hb5p" Jul 02 16:38:01.601380 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.601348 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86g2z\" (UniqueName: \"kubernetes.io/projected/a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb-kube-api-access-86g2z\") pod \"multus-5v4fr\" (UID: \"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb\") " pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.601644 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.601629 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxr6x\" (UniqueName: \"kubernetes.io/projected/56c62a91-75b9-497f-8114-278f6da1fcce-kube-api-access-sxr6x\") pod \"ovnkube-node-w9jrc\" (UID: \"56c62a91-75b9-497f-8114-278f6da1fcce\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.601802 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.601748 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bst4h\" (UniqueName: \"kubernetes.io/projected/df8ac230-f7d1-418a-b4a0-6318f84ca274-kube-api-access-bst4h\") pod \"iptables-alerter-kr5gx\" (UID: \"df8ac230-f7d1-418a-b4a0-6318f84ca274\") " pod="openshift-network-operator/iptables-alerter-kr5gx" Jul 02 16:38:01.602257 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.602243 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vz2t\" (UniqueName: \"kubernetes.io/projected/156cb232-e7c6-4352-b91f-26673a603734-kube-api-access-7vz2t\") pod \"multus-additional-cni-plugins-zlxgn\" (UID: \"156cb232-e7c6-4352-b91f-26673a603734\") " pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.693938 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.693892 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz9mc\" (UniqueName: \"kubernetes.io/projected/d24254f4-7e70-4cce-9d46-282a3277589d-kube-api-access-vz9mc\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.693938 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.693934 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76cf1749-1a4a-46b2-82a8-1d70fd022f0e-konnectivity-ca\") pod \"konnectivity-agent-7575b\" (UID: \"76cf1749-1a4a-46b2-82a8-1d70fd022f0e\") " pod="kube-system/konnectivity-agent-7575b" Jul 02 16:38:01.694182 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.693954 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-sys\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.694182 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.693970 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d24254f4-7e70-4cce-9d46-282a3277589d-etc-selinux\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.694182 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.693987 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-dbus\") pod \"global-pull-secret-syncer-s6vg5\" (UID: \"c53fa6ea-2dd2-4c30-b86f-f6a9eca60083\") " pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:01.694182 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694017 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-sysctl-conf\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.694182 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694041 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-modprobe-d\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.694182 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694060 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-kubernetes\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.694182 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694069 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-sys\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.694182 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694096 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-dbus\") pod \"global-pull-secret-syncer-s6vg5\" (UID: \"c53fa6ea-2dd2-4c30-b86f-f6a9eca60083\") " pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:01.694182 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694125 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d24254f4-7e70-4cce-9d46-282a3277589d-etc-selinux\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.694182 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694147 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-systemd\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.694182 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694181 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-kubernetes\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.694182 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694184 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-kubelet-config\") pod \"global-pull-secret-syncer-s6vg5\" (UID: \"c53fa6ea-2dd2-4c30-b86f-f6a9eca60083\") " pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:01.694754 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694220 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6005b159-6ea6-4bd2-9e3a-357e951af2c1-tmp\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.694754 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694246 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d24254f4-7e70-4cce-9d46-282a3277589d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.694754 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694265 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-modprobe-d\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.694754 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694259 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-sysctl-conf\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.694754 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694300 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d24254f4-7e70-4cce-9d46-282a3277589d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.694754 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694323 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-kubelet-config\") pod \"global-pull-secret-syncer-s6vg5\" (UID: \"c53fa6ea-2dd2-4c30-b86f-f6a9eca60083\") " pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:01.694754 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694342 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-systemd\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.694754 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694366 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d24254f4-7e70-4cce-9d46-282a3277589d-sys-fs\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.694754 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694403 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c724b\" (UniqueName: \"kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b\") pod \"network-check-target-qq7d5\" (UID: \"3717aa36-be52-423e-ab4d-292c1785b1b4\") " pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:01.694754 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694411 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d24254f4-7e70-4cce-9d46-282a3277589d-sys-fs\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.694754 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694432 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76cf1749-1a4a-46b2-82a8-1d70fd022f0e-agent-certs\") pod \"konnectivity-agent-7575b\" (UID: \"76cf1749-1a4a-46b2-82a8-1d70fd022f0e\") " pod="kube-system/konnectivity-agent-7575b" Jul 02 16:38:01.694754 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694460 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-tuned\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.694754 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694499 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-lib-modules\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.694754 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694524 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbznc\" (UniqueName: \"kubernetes.io/projected/6005b159-6ea6-4bd2-9e3a-357e951af2c1-kube-api-access-tbznc\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.694754 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694549 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d24254f4-7e70-4cce-9d46-282a3277589d-device-dir\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.694754 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694569 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76cf1749-1a4a-46b2-82a8-1d70fd022f0e-konnectivity-ca\") pod \"konnectivity-agent-7575b\" (UID: \"76cf1749-1a4a-46b2-82a8-1d70fd022f0e\") " pod="kube-system/konnectivity-agent-7575b" Jul 02 16:38:01.694754 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694579 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-host\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.695552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694603 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mthjc\" (UniqueName: \"kubernetes.io/projected/89ea8114-cf19-48eb-a43f-1ea418757a27-kube-api-access-mthjc\") pod \"network-metrics-daemon-nxkt7\" (UID: \"89ea8114-cf19-48eb-a43f-1ea418757a27\") " pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:01.695552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694628 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d24254f4-7e70-4cce-9d46-282a3277589d-socket-dir\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.695552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694637 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d24254f4-7e70-4cce-9d46-282a3277589d-device-dir\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.695552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694638 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-lib-modules\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.695552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694664 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-var-lib-kubelet\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.695552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694674 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-host\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.695552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694691 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d24254f4-7e70-4cce-9d46-282a3277589d-registration-dir\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.695552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694717 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret\") pod \"global-pull-secret-syncer-s6vg5\" (UID: \"c53fa6ea-2dd2-4c30-b86f-f6a9eca60083\") " pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:01.695552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694738 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-var-lib-kubelet\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.695552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694746 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-sysconfig\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.695552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694764 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d24254f4-7e70-4cce-9d46-282a3277589d-socket-dir\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.695552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694775 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-sysctl-d\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.695552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694795 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-run\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.695552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694818 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs\") pod \"network-metrics-daemon-nxkt7\" (UID: \"89ea8114-cf19-48eb-a43f-1ea418757a27\") " pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:01.695552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694844 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-sysconfig\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.695552 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:01.694855 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:01.695552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694794 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d24254f4-7e70-4cce-9d46-282a3277589d-registration-dir\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.695552 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:01.694935 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:01.696282 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:01.694951 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret podName:c53fa6ea-2dd2-4c30-b86f-f6a9eca60083 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:02.194928791 +0000 UTC m=+2.111904298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret") pod "global-pull-secret-syncer-s6vg5" (UID: "c53fa6ea-2dd2-4c30-b86f-f6a9eca60083") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:01.696282 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.694954 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-run\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.696282 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:01.694986 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs podName:89ea8114-cf19-48eb-a43f-1ea418757a27 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:02.194968014 +0000 UTC m=+2.111943523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs") pod "network-metrics-daemon-nxkt7" (UID: "89ea8114-cf19-48eb-a43f-1ea418757a27") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:01.696282 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.695064 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-sysctl-d\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.696546 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.696530 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6005b159-6ea6-4bd2-9e3a-357e951af2c1-tmp\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.696881 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.696854 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6005b159-6ea6-4bd2-9e3a-357e951af2c1-etc-tuned\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.696881 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.696873 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76cf1749-1a4a-46b2-82a8-1d70fd022f0e-agent-certs\") pod \"konnectivity-agent-7575b\" (UID: \"76cf1749-1a4a-46b2-82a8-1d70fd022f0e\") " pod="kube-system/konnectivity-agent-7575b" Jul 02 16:38:01.701004 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:01.700989 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:38:01.701004 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:01.701006 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:38:01.701117 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:01.701017 2573 projected.go:196] Error preparing data for projected volume kube-api-access-c724b for pod openshift-network-diagnostics/network-check-target-qq7d5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:01.701117 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:01.701065 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b podName:3717aa36-be52-423e-ab4d-292c1785b1b4 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:02.201050953 +0000 UTC m=+2.118026461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c724b" (UniqueName: "kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b") pod "network-check-target-qq7d5" (UID: "3717aa36-be52-423e-ab4d-292c1785b1b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:01.701563 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.701546 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz9mc\" (UniqueName: \"kubernetes.io/projected/d24254f4-7e70-4cce-9d46-282a3277589d-kube-api-access-vz9mc\") pod \"aws-ebs-csi-driver-node-dcl52\" (UID: \"d24254f4-7e70-4cce-9d46-282a3277589d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.703759 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.703733 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbznc\" (UniqueName: \"kubernetes.io/projected/6005b159-6ea6-4bd2-9e3a-357e951af2c1-kube-api-access-tbznc\") pod \"tuned-gjc8m\" (UID: \"6005b159-6ea6-4bd2-9e3a-357e951af2c1\") " pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.703850 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.703824 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mthjc\" (UniqueName: \"kubernetes.io/projected/89ea8114-cf19-48eb-a43f-1ea418757a27-kube-api-access-mthjc\") pod \"network-metrics-daemon-nxkt7\" (UID: \"89ea8114-cf19-48eb-a43f-1ea418757a27\") " pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:01.793364 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.793330 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zlxgn" Jul 02 16:38:01.802437 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:01.802412 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod156cb232_e7c6_4352_b91f_26673a603734.slice/crio-df469b6fb17fdfdcfe6ebaebdce091e414e4b9505e1acdd39ed3bb27998873b3 WatchSource:0}: Error finding container df469b6fb17fdfdcfe6ebaebdce091e414e4b9505e1acdd39ed3bb27998873b3: Status 404 returned error can't find the container with id df469b6fb17fdfdcfe6ebaebdce091e414e4b9505e1acdd39ed3bb27998873b3 Jul 02 16:38:01.810033 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.810014 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6hb5p" Jul 02 16:38:01.817694 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:01.817665 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf010754_1ca0_4088_82fe_281768fbea72.slice/crio-df6be7138a196c68a0997c0bcc57f9f5e3765cccbe926e5fc4fabb9ce4e579c5 WatchSource:0}: Error finding container df6be7138a196c68a0997c0bcc57f9f5e3765cccbe926e5fc4fabb9ce4e579c5: Status 404 returned error can't find the container with id df6be7138a196c68a0997c0bcc57f9f5e3765cccbe926e5fc4fabb9ce4e579c5 Jul 02 16:38:01.831244 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.831217 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kr5gx" Jul 02 16:38:01.839282 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:01.839253 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf8ac230_f7d1_418a_b4a0_6318f84ca274.slice/crio-5ea43d8a2e3f66fb58f57da82719657acf51ee99efbe9968b3dc160fac9c5a12 WatchSource:0}: Error finding container 5ea43d8a2e3f66fb58f57da82719657acf51ee99efbe9968b3dc160fac9c5a12: Status 404 returned error can't find the container with id 5ea43d8a2e3f66fb58f57da82719657acf51ee99efbe9968b3dc160fac9c5a12 Jul 02 16:38:01.851746 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.851695 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-djv7s" Jul 02 16:38:01.857797 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.857538 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:01.860382 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:01.860359 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b0f564_fcdb_46ab_a6b7_a0f73f493c6c.slice/crio-2d2e2400694732c1a3808bb1c759567cd4f92ce798acf5d7fa4595cce1ac0114 WatchSource:0}: Error finding container 2d2e2400694732c1a3808bb1c759567cd4f92ce798acf5d7fa4595cce1ac0114: Status 404 returned error can't find the container with id 2d2e2400694732c1a3808bb1c759567cd4f92ce798acf5d7fa4595cce1ac0114 Jul 02 16:38:01.862138 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.862120 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5v4fr" Jul 02 16:38:01.864964 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:01.864933 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56c62a91_75b9_497f_8114_278f6da1fcce.slice/crio-fbbf9736bbed80be2dedd5cdcad06b9538fdc24ed92936468ec33b72ad9169b2 WatchSource:0}: Error finding container fbbf9736bbed80be2dedd5cdcad06b9538fdc24ed92936468ec33b72ad9169b2: Status 404 returned error can't find the container with id fbbf9736bbed80be2dedd5cdcad06b9538fdc24ed92936468ec33b72ad9169b2 Jul 02 16:38:01.868060 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.868038 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" Jul 02 16:38:01.869799 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:01.869781 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda86fe19d_9b81_40d7_8dfc_cf3ff4981bcb.slice/crio-d6ffc527aed87215cee54333f4e4aaf1a9c3c064e73938362b4cd1c0f94a9cf7 WatchSource:0}: Error finding container d6ffc527aed87215cee54333f4e4aaf1a9c3c064e73938362b4cd1c0f94a9cf7: Status 404 returned error can't find the container with id d6ffc527aed87215cee54333f4e4aaf1a9c3c064e73938362b4cd1c0f94a9cf7 Jul 02 16:38:01.874437 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.874418 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7575b" Jul 02 16:38:01.875161 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:01.875142 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd24254f4_7e70_4cce_9d46_282a3277589d.slice/crio-2cddc112c7841ed5f02cb3909d3660ef957ba1727b0a4327ce302b0f69c98a33 WatchSource:0}: Error finding container 2cddc112c7841ed5f02cb3909d3660ef957ba1727b0a4327ce302b0f69c98a33: Status 404 returned error can't find the container with id 2cddc112c7841ed5f02cb3909d3660ef957ba1727b0a4327ce302b0f69c98a33 Jul 02 16:38:01.879228 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:01.879207 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" Jul 02 16:38:01.881916 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:01.881893 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76cf1749_1a4a_46b2_82a8_1d70fd022f0e.slice/crio-83c7ee27173f8987f986c7535355890ed7f9256b85c360fa9a8789a17431740e WatchSource:0}: Error finding container 83c7ee27173f8987f986c7535355890ed7f9256b85c360fa9a8789a17431740e: Status 404 returned error can't find the container with id 83c7ee27173f8987f986c7535355890ed7f9256b85c360fa9a8789a17431740e Jul 02 16:38:01.886587 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:01.886567 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6005b159_6ea6_4bd2_9e3a_357e951af2c1.slice/crio-d1e7e33c5485a6d046520d8f9fb157a8ac58709e676125b88a9b9a8d05601436 WatchSource:0}: Error finding container d1e7e33c5485a6d046520d8f9fb157a8ac58709e676125b88a9b9a8d05601436: Status 404 returned error can't find the container with id d1e7e33c5485a6d046520d8f9fb157a8ac58709e676125b88a9b9a8d05601436 Jul 02 16:38:02.199766 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:02.198904 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret\") pod \"global-pull-secret-syncer-s6vg5\" (UID: \"c53fa6ea-2dd2-4c30-b86f-f6a9eca60083\") " pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:02.199766 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:02.198960 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs\") pod \"network-metrics-daemon-nxkt7\" (UID: \"89ea8114-cf19-48eb-a43f-1ea418757a27\") " pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:02.199766 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:02.199160 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:02.199766 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:02.199228 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs podName:89ea8114-cf19-48eb-a43f-1ea418757a27 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:03.199208463 +0000 UTC m=+3.116183991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs") pod "network-metrics-daemon-nxkt7" (UID: "89ea8114-cf19-48eb-a43f-1ea418757a27") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:02.199766 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:02.199298 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:02.199766 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:02.199333 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret podName:c53fa6ea-2dd2-4c30-b86f-f6a9eca60083 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:03.199322341 +0000 UTC m=+3.116297853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret") pod "global-pull-secret-syncer-s6vg5" (UID: "c53fa6ea-2dd2-4c30-b86f-f6a9eca60083") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:02.299965 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:02.299918 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c724b\" (UniqueName: \"kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b\") pod \"network-check-target-qq7d5\" (UID: \"3717aa36-be52-423e-ab4d-292c1785b1b4\") " pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:02.300172 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:02.300116 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:38:02.300172 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:02.300142 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:38:02.300172 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:02.300155 2573 projected.go:196] Error preparing data for projected volume kube-api-access-c724b for pod openshift-network-diagnostics/network-check-target-qq7d5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:02.300276 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:02.300220 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b podName:3717aa36-be52-423e-ab4d-292c1785b1b4 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:03.300202762 +0000 UTC m=+3.217178270 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c724b" (UniqueName: "kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b") pod "network-check-target-qq7d5" (UID: "3717aa36-be52-423e-ab4d-292c1785b1b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:02.393382 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:02.393353 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:38:02.524507 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:02.524355 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 16:33:01 +0000 UTC" deadline="2027-12-03 12:21:14.932774157 +0000 UTC" Jul 02 16:38:02.524507 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:02.524396 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12451h43m12.408383095s" Jul 02 16:38:02.591860 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:02.591792 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" event={"ID":"6005b159-6ea6-4bd2-9e3a-357e951af2c1","Type":"ContainerStarted","Data":"d1e7e33c5485a6d046520d8f9fb157a8ac58709e676125b88a9b9a8d05601436"} Jul 02 16:38:02.606140 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:02.606101 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" event={"ID":"d24254f4-7e70-4cce-9d46-282a3277589d","Type":"ContainerStarted","Data":"2cddc112c7841ed5f02cb3909d3660ef957ba1727b0a4327ce302b0f69c98a33"} Jul 02 16:38:02.621271 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:02.621184 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5v4fr" event={"ID":"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb","Type":"ContainerStarted","Data":"d6ffc527aed87215cee54333f4e4aaf1a9c3c064e73938362b4cd1c0f94a9cf7"} Jul 02 16:38:02.634160 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:02.634075 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-djv7s" event={"ID":"a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c","Type":"ContainerStarted","Data":"2d2e2400694732c1a3808bb1c759567cd4f92ce798acf5d7fa4595cce1ac0114"} Jul 02 16:38:02.639993 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:02.639896 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zlxgn" event={"ID":"156cb232-e7c6-4352-b91f-26673a603734","Type":"ContainerStarted","Data":"df469b6fb17fdfdcfe6ebaebdce091e414e4b9505e1acdd39ed3bb27998873b3"} Jul 02 16:38:02.672502 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:02.672390 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal" event={"ID":"339e53908043e400474ae006b0043081","Type":"ContainerStarted","Data":"a796598d95a2fe65cec8a19db5abd3d0f2b62dcdb789404b89f69259b7bca4ff"} Jul 02 16:38:02.676567 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:02.676459 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7575b" event={"ID":"76cf1749-1a4a-46b2-82a8-1d70fd022f0e","Type":"ContainerStarted","Data":"83c7ee27173f8987f986c7535355890ed7f9256b85c360fa9a8789a17431740e"} Jul 02 16:38:02.679697 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:02.679579 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" event={"ID":"56c62a91-75b9-497f-8114-278f6da1fcce","Type":"ContainerStarted","Data":"fbbf9736bbed80be2dedd5cdcad06b9538fdc24ed92936468ec33b72ad9169b2"} Jul 02 16:38:02.691417 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:02.691334 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kr5gx" event={"ID":"df8ac230-f7d1-418a-b4a0-6318f84ca274","Type":"ContainerStarted","Data":"5ea43d8a2e3f66fb58f57da82719657acf51ee99efbe9968b3dc160fac9c5a12"} Jul 02 16:38:02.718953 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:02.718853 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6hb5p" event={"ID":"cf010754-1ca0-4088-82fe-281768fbea72","Type":"ContainerStarted","Data":"df6be7138a196c68a0997c0bcc57f9f5e3765cccbe926e5fc4fabb9ce4e579c5"} Jul 02 16:38:02.729220 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:02.729142 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-249.ec2.internal" event={"ID":"a77a55fac5f1e674526bbab8b6258dc4","Type":"ContainerStarted","Data":"0bc729730e90b0e72717b480540e7ae1be90a1a33d60a3ca1474ab890be1c2d5"} Jul 02 16:38:02.965599 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:02.965517 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:38:03.208682 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:03.208640 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs\") pod \"network-metrics-daemon-nxkt7\" (UID: \"89ea8114-cf19-48eb-a43f-1ea418757a27\") " pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:03.208880 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:03.208752 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret\") pod \"global-pull-secret-syncer-s6vg5\" (UID: \"c53fa6ea-2dd2-4c30-b86f-f6a9eca60083\") " pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:03.208949 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:03.208896 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:03.209000 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:03.208959 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret podName:c53fa6ea-2dd2-4c30-b86f-f6a9eca60083 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:05.208940595 +0000 UTC m=+5.125916103 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret") pod "global-pull-secret-syncer-s6vg5" (UID: "c53fa6ea-2dd2-4c30-b86f-f6a9eca60083") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:03.209405 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:03.209381 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:03.209528 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:03.209440 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs podName:89ea8114-cf19-48eb-a43f-1ea418757a27 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:05.20942377 +0000 UTC m=+5.126399280 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs") pod "network-metrics-daemon-nxkt7" (UID: "89ea8114-cf19-48eb-a43f-1ea418757a27") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:03.309230 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:03.309140 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c724b\" (UniqueName: \"kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b\") pod \"network-check-target-qq7d5\" (UID: \"3717aa36-be52-423e-ab4d-292c1785b1b4\") " pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:03.309406 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:03.309311 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:38:03.309406 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:03.309336 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:38:03.309406 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:03.309350 2573 projected.go:196] Error preparing data for projected volume kube-api-access-c724b for pod openshift-network-diagnostics/network-check-target-qq7d5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:03.309585 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:03.309415 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b podName:3717aa36-be52-423e-ab4d-292c1785b1b4 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:05.309395179 +0000 UTC m=+5.226370704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c724b" (UniqueName: "kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b") pod "network-check-target-qq7d5" (UID: "3717aa36-be52-423e-ab4d-292c1785b1b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:03.525207 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:03.525139 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 16:33:01 +0000 UTC" deadline="2028-03-01 15:25:01.201427764 +0000 UTC" Jul 02 16:38:03.525207 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:03.525204 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14590h46m57.676227475s" Jul 02 16:38:03.550108 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:03.550078 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:03.550322 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:03.550290 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:38:03.550762 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:03.550743 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:03.550862 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:03.550841 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq7d5" podUID="3717aa36-be52-423e-ab4d-292c1785b1b4" Jul 02 16:38:03.550927 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:03.550898 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:03.550984 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:03.550966 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6vg5" podUID="c53fa6ea-2dd2-4c30-b86f-f6a9eca60083" Jul 02 16:38:03.778368 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:03.778283 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 16:38:05.225065 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:05.224313 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret\") pod \"global-pull-secret-syncer-s6vg5\" (UID: \"c53fa6ea-2dd2-4c30-b86f-f6a9eca60083\") " pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:05.225065 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:05.224367 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs\") pod \"network-metrics-daemon-nxkt7\" (UID: \"89ea8114-cf19-48eb-a43f-1ea418757a27\") " pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:05.225065 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:05.224527 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:05.225065 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:05.224594 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs podName:89ea8114-cf19-48eb-a43f-1ea418757a27 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:09.224574608 +0000 UTC m=+9.141550117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs") pod "network-metrics-daemon-nxkt7" (UID: "89ea8114-cf19-48eb-a43f-1ea418757a27") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:05.225065 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:05.224980 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:05.225065 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:05.225033 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret podName:c53fa6ea-2dd2-4c30-b86f-f6a9eca60083 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:09.225017489 +0000 UTC m=+9.141993011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret") pod "global-pull-secret-syncer-s6vg5" (UID: "c53fa6ea-2dd2-4c30-b86f-f6a9eca60083") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:05.325339 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:05.325306 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c724b\" (UniqueName: \"kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b\") pod \"network-check-target-qq7d5\" (UID: \"3717aa36-be52-423e-ab4d-292c1785b1b4\") " pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:05.325535 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:05.325433 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:38:05.325535 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:05.325449 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:38:05.325535 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:05.325458 2573 projected.go:196] Error preparing data for projected volume kube-api-access-c724b for pod openshift-network-diagnostics/network-check-target-qq7d5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:05.325535 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:05.325519 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b podName:3717aa36-be52-423e-ab4d-292c1785b1b4 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:09.325505862 +0000 UTC m=+9.242481368 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c724b" (UniqueName: "kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b") pod "network-check-target-qq7d5" (UID: "3717aa36-be52-423e-ab4d-292c1785b1b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:05.549316 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:05.549167 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:05.549483 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:05.549309 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:05.549483 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:05.549322 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:38:05.549483 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:05.549356 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:05.549483 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:05.549456 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6vg5" podUID="c53fa6ea-2dd2-4c30-b86f-f6a9eca60083" Jul 02 16:38:05.549719 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:05.549559 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq7d5" podUID="3717aa36-be52-423e-ab4d-292c1785b1b4" Jul 02 16:38:07.549455 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:07.549418 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:07.549940 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:07.549511 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:07.549940 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:07.549648 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:07.549940 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:07.549643 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6vg5" podUID="c53fa6ea-2dd2-4c30-b86f-f6a9eca60083" Jul 02 16:38:07.549940 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:07.549776 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:38:07.549940 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:07.549867 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq7d5" podUID="3717aa36-be52-423e-ab4d-292c1785b1b4" Jul 02 16:38:09.257732 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:09.257688 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret\") pod \"global-pull-secret-syncer-s6vg5\" (UID: \"c53fa6ea-2dd2-4c30-b86f-f6a9eca60083\") " pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:09.258219 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:09.257748 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs\") pod \"network-metrics-daemon-nxkt7\" (UID: \"89ea8114-cf19-48eb-a43f-1ea418757a27\") " pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:09.258219 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:09.257917 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:09.258219 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:09.257981 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs podName:89ea8114-cf19-48eb-a43f-1ea418757a27 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:17.257961968 +0000 UTC m=+17.174937476 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs") pod "network-metrics-daemon-nxkt7" (UID: "89ea8114-cf19-48eb-a43f-1ea418757a27") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:09.258392 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:09.258345 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:09.258392 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:09.258389 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret podName:c53fa6ea-2dd2-4c30-b86f-f6a9eca60083 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:17.258376961 +0000 UTC m=+17.175352466 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret") pod "global-pull-secret-syncer-s6vg5" (UID: "c53fa6ea-2dd2-4c30-b86f-f6a9eca60083") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:09.358998 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:09.358960 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c724b\" (UniqueName: \"kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b\") pod \"network-check-target-qq7d5\" (UID: \"3717aa36-be52-423e-ab4d-292c1785b1b4\") " pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:09.359183 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:09.359166 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:38:09.359264 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:09.359191 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:38:09.359264 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:09.359205 2573 projected.go:196] Error preparing data for projected volume kube-api-access-c724b for pod openshift-network-diagnostics/network-check-target-qq7d5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:09.359368 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:09.359272 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b podName:3717aa36-be52-423e-ab4d-292c1785b1b4 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:17.359251222 +0000 UTC m=+17.276226742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c724b" (UniqueName: "kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b") pod "network-check-target-qq7d5" (UID: "3717aa36-be52-423e-ab4d-292c1785b1b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:09.550144 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:09.549929 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:09.550144 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:09.549946 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:09.550144 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:09.549930 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:09.550144 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:09.550069 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6vg5" podUID="c53fa6ea-2dd2-4c30-b86f-f6a9eca60083" Jul 02 16:38:09.550553 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:09.550170 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq7d5" podUID="3717aa36-be52-423e-ab4d-292c1785b1b4" Jul 02 16:38:09.550553 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:09.550264 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:38:11.549451 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:11.549360 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:11.549925 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:11.549513 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6vg5" podUID="c53fa6ea-2dd2-4c30-b86f-f6a9eca60083" Jul 02 16:38:11.549925 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:11.549381 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:11.549925 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:11.549625 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:38:11.549925 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:11.549375 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:11.549925 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:11.549691 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq7d5" podUID="3717aa36-be52-423e-ab4d-292c1785b1b4" Jul 02 16:38:13.549950 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:13.549911 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:13.549950 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:13.549950 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:13.550488 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:13.549956 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:13.550488 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:13.550046 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6vg5" podUID="c53fa6ea-2dd2-4c30-b86f-f6a9eca60083" Jul 02 16:38:13.550488 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:13.550148 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq7d5" podUID="3717aa36-be52-423e-ab4d-292c1785b1b4" Jul 02 16:38:13.550488 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:13.550234 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:38:15.549629 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:15.549359 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:15.550098 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:15.549386 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:15.550098 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:15.549743 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6vg5" podUID="c53fa6ea-2dd2-4c30-b86f-f6a9eca60083" Jul 02 16:38:15.550098 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:15.549386 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:15.550098 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:15.549808 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq7d5" podUID="3717aa36-be52-423e-ab4d-292c1785b1b4" Jul 02 16:38:15.550098 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:15.549863 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:38:17.316319 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:17.316282 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs\") pod \"network-metrics-daemon-nxkt7\" (UID: \"89ea8114-cf19-48eb-a43f-1ea418757a27\") " pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:17.316734 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:17.316344 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret\") pod \"global-pull-secret-syncer-s6vg5\" (UID: \"c53fa6ea-2dd2-4c30-b86f-f6a9eca60083\") " pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:17.316734 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:17.316438 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:17.316734 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:17.316440 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:17.316734 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:17.316513 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret podName:c53fa6ea-2dd2-4c30-b86f-f6a9eca60083 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:33.316495484 +0000 UTC m=+33.233471005 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret") pod "global-pull-secret-syncer-s6vg5" (UID: "c53fa6ea-2dd2-4c30-b86f-f6a9eca60083") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:17.316734 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:17.316531 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs podName:89ea8114-cf19-48eb-a43f-1ea418757a27 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:33.316522287 +0000 UTC m=+33.233497792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs") pod "network-metrics-daemon-nxkt7" (UID: "89ea8114-cf19-48eb-a43f-1ea418757a27") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:17.416644 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:17.416605 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c724b\" (UniqueName: \"kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b\") pod \"network-check-target-qq7d5\" (UID: \"3717aa36-be52-423e-ab4d-292c1785b1b4\") " pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:17.416785 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:17.416765 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:38:17.416827 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:17.416791 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:38:17.416827 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:17.416802 2573 projected.go:196] Error preparing data for projected volume kube-api-access-c724b for pod openshift-network-diagnostics/network-check-target-qq7d5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:17.416897 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:17.416851 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b podName:3717aa36-be52-423e-ab4d-292c1785b1b4 nodeName:}" failed. No retries permitted until 2026-07-02 16:38:33.416837292 +0000 UTC m=+33.333812797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c724b" (UniqueName: "kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b") pod "network-check-target-qq7d5" (UID: "3717aa36-be52-423e-ab4d-292c1785b1b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:17.549225 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:17.549130 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:17.549225 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:17.549152 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:17.549225 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:17.549152 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:17.549506 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:17.549252 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6vg5" podUID="c53fa6ea-2dd2-4c30-b86f-f6a9eca60083" Jul 02 16:38:17.549506 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:17.549327 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:38:17.549506 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:17.549435 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq7d5" podUID="3717aa36-be52-423e-ab4d-292c1785b1b4" Jul 02 16:38:19.550040 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:19.549997 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:19.550040 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:19.550042 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:19.550563 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:19.550143 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:19.550563 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:19.550151 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6vg5" podUID="c53fa6ea-2dd2-4c30-b86f-f6a9eca60083" Jul 02 16:38:19.550563 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:19.550247 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq7d5" podUID="3717aa36-be52-423e-ab4d-292c1785b1b4" Jul 02 16:38:19.550563 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:19.550322 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:38:21.549262 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:21.549219 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:21.549262 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:21.549251 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:21.549765 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:21.549255 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:21.549765 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:21.549368 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:38:21.549765 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:21.549443 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6vg5" podUID="c53fa6ea-2dd2-4c30-b86f-f6a9eca60083" Jul 02 16:38:21.549765 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:21.549509 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq7d5" podUID="3717aa36-be52-423e-ab4d-292c1785b1b4" Jul 02 16:38:22.774949 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:22.774908 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" event={"ID":"56c62a91-75b9-497f-8114-278f6da1fcce","Type":"ContainerStarted","Data":"cc4d4149f0d000b5fed6f3a1b853901b8ce092a5da24187b65ff7af5152a1d5b"} Jul 02 16:38:22.776430 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:22.776400 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-249.ec2.internal" event={"ID":"a77a55fac5f1e674526bbab8b6258dc4","Type":"ContainerStarted","Data":"d7d731b7676f469a3d19ad55902a05d6bac621bfa9bb05c4b4cab5516452ef07"} Jul 02 16:38:22.778012 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:22.777987 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" event={"ID":"6005b159-6ea6-4bd2-9e3a-357e951af2c1","Type":"ContainerStarted","Data":"6f47d0ff8c20914d0ea010767db1bb63533055e3f8653ead6055259a063587b9"} Jul 02 16:38:22.779644 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:22.779623 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5v4fr" event={"ID":"a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb","Type":"ContainerStarted","Data":"67ecdb30cc7e140beaeb6685b3411ddc6c79ae74a5df99d734940f7d9de2f2c0"} Jul 02 16:38:22.789859 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:22.789798 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-249.ec2.internal" podStartSLOduration=21.789779732 podStartE2EDuration="21.789779732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:22.789066566 +0000 UTC m=+22.706042095" watchObservedRunningTime="2026-07-02 16:38:22.789779732 +0000 UTC m=+22.706755262" Jul 02 16:38:22.804175 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:22.804134 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gjc8m" podStartSLOduration=2.986887774 podStartE2EDuration="22.804120026s" totalImagesPullingTime="19.817232252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:22.803559167 +0000 UTC m=+22.720534695" watchObservedRunningTime="2026-07-02 16:38:22.804120026 +0000 UTC m=+22.721095552" Jul 02 16:38:22.820301 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:22.820245 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5v4fr" podStartSLOduration=2.722127912 podStartE2EDuration="22.820225231s" totalImagesPullingTime="20.098097319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:22.819420216 +0000 UTC m=+22.736395745" watchObservedRunningTime="2026-07-02 16:38:22.820225231 +0000 UTC m=+22.737200760" Jul 02 16:38:23.550340 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.549962 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:23.550502 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.550015 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:23.550502 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:23.550359 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq7d5" podUID="3717aa36-be52-423e-ab4d-292c1785b1b4" Jul 02 16:38:23.550502 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.550026 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:23.550502 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:23.550428 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6vg5" podUID="c53fa6ea-2dd2-4c30-b86f-f6a9eca60083" Jul 02 16:38:23.550641 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:23.550556 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:38:23.783511 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.783456 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" event={"ID":"d24254f4-7e70-4cce-9d46-282a3277589d","Type":"ContainerStarted","Data":"50d91853733087706e65dbfc740a540b089357a5fda36cae7b56875d04e74c84"} Jul 02 16:38:23.785064 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.785030 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-djv7s" event={"ID":"a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c","Type":"ContainerStarted","Data":"eb5e8b3ff2b91a81846a158c75233f686b3b0d0d7450614ce0a26292799835fb"} Jul 02 16:38:23.786813 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.786787 2573 generic.go:356] "Generic (PLEG): container finished" podID="156cb232-e7c6-4352-b91f-26673a603734" containerID="ead2e8b6532d876ff3d851c33be28e3cac0d1d65c8197a55e0536ab8dbc330b3" exitCode=0 Jul 02 16:38:23.786935 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.786870 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zlxgn" event={"ID":"156cb232-e7c6-4352-b91f-26673a603734","Type":"ContainerDied","Data":"ead2e8b6532d876ff3d851c33be28e3cac0d1d65c8197a55e0536ab8dbc330b3"} Jul 02 16:38:23.788690 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.788400 2573 generic.go:356] "Generic (PLEG): container finished" podID="339e53908043e400474ae006b0043081" containerID="cc5deb7432175deeb16d9cb8a3ed0754772f1aaf52a3dc65a72f22f07ab3b15c" exitCode=0 Jul 02 16:38:23.788690 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.788641 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal" event={"ID":"339e53908043e400474ae006b0043081","Type":"ContainerDied","Data":"cc5deb7432175deeb16d9cb8a3ed0754772f1aaf52a3dc65a72f22f07ab3b15c"} Jul 02 16:38:23.790260 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.790241 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7575b" event={"ID":"76cf1749-1a4a-46b2-82a8-1d70fd022f0e","Type":"ContainerStarted","Data":"5380530524ded09611deff86933560e685fa9d40ede14597188ff534dd7dbb68"} Jul 02 16:38:23.793277 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.793253 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w9jrc_56c62a91-75b9-497f-8114-278f6da1fcce/ovn-acl-logging/0.log" Jul 02 16:38:23.793700 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.793674 2573 generic.go:356] "Generic (PLEG): container finished" podID="56c62a91-75b9-497f-8114-278f6da1fcce" containerID="aef103d4189552ca5387db4ff0b01ed19beb17c73e35d5e25357467344646a86" exitCode=1 Jul 02 16:38:23.793801 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.793719 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" event={"ID":"56c62a91-75b9-497f-8114-278f6da1fcce","Type":"ContainerStarted","Data":"f3ee60625bdd204aae85cc86cc4feffc699bed6eb3d2d1bd71b09572fb3e12d2"} Jul 02 16:38:23.793853 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.793795 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" event={"ID":"56c62a91-75b9-497f-8114-278f6da1fcce","Type":"ContainerStarted","Data":"fd5a98c9f3788a7c2dd257fa72fc99b82028716c412aa81be173d7775c33e649"} Jul 02 16:38:23.793853 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.793834 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" event={"ID":"56c62a91-75b9-497f-8114-278f6da1fcce","Type":"ContainerStarted","Data":"f10c9485ac6e2ac24c508cf747691c9801233c7795443628edf1a3a6224452ae"} Jul 02 16:38:23.793989 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.793863 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" event={"ID":"56c62a91-75b9-497f-8114-278f6da1fcce","Type":"ContainerStarted","Data":"a989bb923866227f267c8c13e990599b210bf1026f32fabfa3b742558a80e707"} Jul 02 16:38:23.793989 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.793891 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" event={"ID":"56c62a91-75b9-497f-8114-278f6da1fcce","Type":"ContainerDied","Data":"aef103d4189552ca5387db4ff0b01ed19beb17c73e35d5e25357467344646a86"} Jul 02 16:38:23.795539 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.795521 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kr5gx" event={"ID":"df8ac230-f7d1-418a-b4a0-6318f84ca274","Type":"ContainerStarted","Data":"f6ffaae62dba7a2e9d60faace0c85eb8a1e75b23034d4d38a6a5705ad0935f61"} Jul 02 16:38:23.797161 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.797135 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6hb5p" event={"ID":"cf010754-1ca0-4088-82fe-281768fbea72","Type":"ContainerStarted","Data":"1eed8245c43d98a4a380bb4df39eff94a6423a028867f5bb567561a9d257d206"} Jul 02 16:38:23.798491 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.798434 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-djv7s" podStartSLOduration=3.939535786 podStartE2EDuration="23.79841844s" totalImagesPullingTime="19.858882654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:23.798319628 +0000 UTC m=+23.715295155" watchObservedRunningTime="2026-07-02 16:38:23.79841844 +0000 UTC m=+23.715393967" Jul 02 16:38:23.812485 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.812376 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6hb5p" podStartSLOduration=3.9507216080000003 podStartE2EDuration="23.812360468s" totalImagesPullingTime="19.86163886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:23.811800142 +0000 UTC m=+23.728775669" watchObservedRunningTime="2026-07-02 16:38:23.812360468 +0000 UTC m=+23.729335995" Jul 02 16:38:23.824771 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.824723 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7575b" podStartSLOduration=4.027763262 podStartE2EDuration="23.824708421s" totalImagesPullingTime="19.796945159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:23.824409911 +0000 UTC m=+23.741385438" watchObservedRunningTime="2026-07-02 16:38:23.824708421 +0000 UTC m=+23.741683947" Jul 02 16:38:23.837337 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.837280 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kr5gx" podStartSLOduration=3.997707284 podStartE2EDuration="23.837257997s" totalImagesPullingTime="19.839550713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:23.836682154 +0000 UTC m=+23.753657682" watchObservedRunningTime="2026-07-02 16:38:23.837257997 +0000 UTC m=+23.754233525" Jul 02 16:38:23.951829 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:23.951790 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7575b_76cf1749-1a4a-46b2-82a8-1d70fd022f0e/konnectivity-agent/0.log" limit=1024 Jul 02 16:38:24.318870 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:24.318837 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 16:38:24.550507 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:24.550327 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T16:38:24.318861866Z","UUID":"43243805-fd0b-4565-ad31-37e8fd497404","Handler":null,"Name":"","Endpoint":""} Jul 02 16:38:24.552202 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:24.552180 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 16:38:24.552202 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:24.552224 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 16:38:24.801350 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:24.801265 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" event={"ID":"d24254f4-7e70-4cce-9d46-282a3277589d","Type":"ContainerStarted","Data":"2495962ab993d849708e0b7e27c0f41c40fc398a3ca950f49bdf960878107bd5"} Jul 02 16:38:24.803094 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:24.803062 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal" event={"ID":"339e53908043e400474ae006b0043081","Type":"ContainerStarted","Data":"07c3df3f78e2b354e367b1d20a715aaf3901a43d6b6f6bb2edf1c79abc7d3a74"} Jul 02 16:38:24.822043 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:24.821995 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-249.ec2.internal" podStartSLOduration=23.821979009 podStartE2EDuration="23.821979009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:24.821943615 +0000 UTC m=+24.738919143" watchObservedRunningTime="2026-07-02 16:38:24.821979009 +0000 UTC m=+24.738954536" Jul 02 16:38:25.549483 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:25.549437 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:25.549717 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:25.549608 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6vg5" podUID="c53fa6ea-2dd2-4c30-b86f-f6a9eca60083" Jul 02 16:38:25.549717 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:25.549437 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:25.549717 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:25.549689 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:38:25.549717 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:25.549437 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:25.549958 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:25.549737 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq7d5" podUID="3717aa36-be52-423e-ab4d-292c1785b1b4" Jul 02 16:38:25.809071 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:25.808990 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w9jrc_56c62a91-75b9-497f-8114-278f6da1fcce/ovn-acl-logging/0.log" Jul 02 16:38:25.809508 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:25.809420 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" event={"ID":"56c62a91-75b9-497f-8114-278f6da1fcce","Type":"ContainerStarted","Data":"455dd4c27124ed3cd6836e675845a15ed46a65a1b541612d9b1d11f5b71a8c40"} Jul 02 16:38:25.811790 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:25.811749 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" event={"ID":"d24254f4-7e70-4cce-9d46-282a3277589d","Type":"ContainerStarted","Data":"c43a16ac6078da951d651aed720b03ef333a0d3f44b50d3d9b322f437f7a1af4"} Jul 02 16:38:25.829977 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:25.829915 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcl52" podStartSLOduration=3.93461015 podStartE2EDuration="25.829892259s" totalImagesPullingTime="21.895282109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:25.829648403 +0000 UTC m=+25.746623929" watchObservedRunningTime="2026-07-02 16:38:25.829892259 +0000 UTC m=+25.746867788" Jul 02 16:38:27.549549 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:27.549529 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:27.549839 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:27.549567 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:27.549839 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:27.549585 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:27.549839 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:27.549673 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq7d5" podUID="3717aa36-be52-423e-ab4d-292c1785b1b4" Jul 02 16:38:27.549839 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:27.549746 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6vg5" podUID="c53fa6ea-2dd2-4c30-b86f-f6a9eca60083" Jul 02 16:38:27.549839 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:27.549826 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:38:28.342863 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:28.342594 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7575b" Jul 02 16:38:28.343209 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:28.343194 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7575b" Jul 02 16:38:28.822309 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:28.822278 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w9jrc_56c62a91-75b9-497f-8114-278f6da1fcce/ovn-acl-logging/0.log" Jul 02 16:38:28.823174 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:28.822691 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" event={"ID":"56c62a91-75b9-497f-8114-278f6da1fcce","Type":"ContainerStarted","Data":"3a6eb2d33d34fcf97db0fd733885478d076a36ef39113a835aaf4ec80e29bb19"} Jul 02 16:38:28.823174 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:28.822962 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:28.823174 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:28.823133 2573 scope.go:117] "RemoveContainer" containerID="aef103d4189552ca5387db4ff0b01ed19beb17c73e35d5e25357467344646a86" Jul 02 16:38:28.824777 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:28.824756 2573 generic.go:356] "Generic (PLEG): container finished" podID="156cb232-e7c6-4352-b91f-26673a603734" containerID="5980c2680595fef7d99c0cfb4d00271c014d72553c3ad9cef023acfee5b19b2b" exitCode=0 Jul 02 16:38:28.824893 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:28.824843 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zlxgn" event={"ID":"156cb232-e7c6-4352-b91f-26673a603734","Type":"ContainerDied","Data":"5980c2680595fef7d99c0cfb4d00271c014d72553c3ad9cef023acfee5b19b2b"} Jul 02 16:38:28.825112 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:28.825071 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7575b" Jul 02 16:38:28.825616 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:28.825550 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7575b" Jul 02 16:38:28.840946 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:28.840927 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:29.550581 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:29.550546 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:29.550581 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:29.550565 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:29.550581 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:29.550565 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:29.551111 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:29.550657 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:38:29.551111 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:29.550736 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6vg5" podUID="c53fa6ea-2dd2-4c30-b86f-f6a9eca60083" Jul 02 16:38:29.551111 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:29.550797 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq7d5" podUID="3717aa36-be52-423e-ab4d-292c1785b1b4" Jul 02 16:38:29.830694 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:29.830667 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w9jrc_56c62a91-75b9-497f-8114-278f6da1fcce/ovn-acl-logging/0.log" Jul 02 16:38:29.831097 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:29.831038 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" event={"ID":"56c62a91-75b9-497f-8114-278f6da1fcce","Type":"ContainerStarted","Data":"465709e2d7911f551329e63673cfa8353dc797f72ca078bef63a3bad95ca533d"} Jul 02 16:38:29.831348 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:29.831318 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:29.831438 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:29.831395 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:29.833225 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:29.833205 2573 generic.go:356] "Generic (PLEG): container finished" podID="156cb232-e7c6-4352-b91f-26673a603734" containerID="eb8c305fe61c4a4b03f4c042d9376d9e2e24d112f76388899608c5af99d1e628" exitCode=0 Jul 02 16:38:29.833343 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:29.833262 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zlxgn" event={"ID":"156cb232-e7c6-4352-b91f-26673a603734","Type":"ContainerDied","Data":"eb8c305fe61c4a4b03f4c042d9376d9e2e24d112f76388899608c5af99d1e628"} Jul 02 16:38:29.846772 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:29.846750 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:38:29.857706 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:29.857666 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" podStartSLOduration=9.129248536 podStartE2EDuration="29.857652075s" totalImagesPullingTime="20.728403539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:29.856587577 +0000 UTC m=+29.773563105" watchObservedRunningTime="2026-07-02 16:38:29.857652075 +0000 UTC m=+29.774627601" Jul 02 16:38:30.242490 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:30.242354 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s6vg5"] Jul 02 16:38:30.242679 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:30.242532 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:30.242679 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:30.242638 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6vg5" podUID="c53fa6ea-2dd2-4c30-b86f-f6a9eca60083" Jul 02 16:38:30.243365 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:30.243341 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nxkt7"] Jul 02 16:38:30.243575 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:30.243463 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:30.243661 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:30.243615 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:38:30.244031 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:30.244010 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qq7d5"] Jul 02 16:38:30.244125 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:30.244112 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:30.244219 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:30.244198 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq7d5" podUID="3717aa36-be52-423e-ab4d-292c1785b1b4" Jul 02 16:38:31.549440 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:31.549407 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:31.549799 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:31.549566 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6vg5" podUID="c53fa6ea-2dd2-4c30-b86f-f6a9eca60083" Jul 02 16:38:31.840587 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:31.840557 2573 generic.go:356] "Generic (PLEG): container finished" podID="156cb232-e7c6-4352-b91f-26673a603734" containerID="5edb65b60844cfce05f53b65835622098c5ac103cf0873b48bf918f70352e4a5" exitCode=0 Jul 02 16:38:31.840755 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:31.840638 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zlxgn" event={"ID":"156cb232-e7c6-4352-b91f-26673a603734","Type":"ContainerDied","Data":"5edb65b60844cfce05f53b65835622098c5ac103cf0873b48bf918f70352e4a5"} Jul 02 16:38:32.549422 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:32.549384 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:32.549637 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:32.549538 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq7d5" podUID="3717aa36-be52-423e-ab4d-292c1785b1b4" Jul 02 16:38:32.549637 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:32.549594 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:32.550122 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:32.549723 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:38:33.333698 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:33.333458 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret\") pod \"global-pull-secret-syncer-s6vg5\" (UID: \"c53fa6ea-2dd2-4c30-b86f-f6a9eca60083\") " pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:33.333878 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:33.333723 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs\") pod \"network-metrics-daemon-nxkt7\" (UID: \"89ea8114-cf19-48eb-a43f-1ea418757a27\") " pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:33.333878 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:33.333609 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:33.333878 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:33.333829 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret podName:c53fa6ea-2dd2-4c30-b86f-f6a9eca60083 nodeName:}" failed. No retries permitted until 2026-07-02 16:39:05.333808034 +0000 UTC m=+65.250783559 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret") pod "global-pull-secret-syncer-s6vg5" (UID: "c53fa6ea-2dd2-4c30-b86f-f6a9eca60083") : object "kube-system"/"original-pull-secret" not registered Jul 02 16:38:33.333878 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:33.333836 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:33.333878 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:33.333871 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs podName:89ea8114-cf19-48eb-a43f-1ea418757a27 nodeName:}" failed. No retries permitted until 2026-07-02 16:39:05.333860045 +0000 UTC m=+65.250835550 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs") pod "network-metrics-daemon-nxkt7" (UID: "89ea8114-cf19-48eb-a43f-1ea418757a27") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 16:38:33.434751 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:33.434708 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c724b\" (UniqueName: \"kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b\") pod \"network-check-target-qq7d5\" (UID: \"3717aa36-be52-423e-ab4d-292c1785b1b4\") " pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:33.434931 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:33.434906 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 16:38:33.434931 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:33.434929 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 16:38:33.435016 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:33.434945 2573 projected.go:196] Error preparing data for projected volume kube-api-access-c724b for pod openshift-network-diagnostics/network-check-target-qq7d5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:33.435016 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:33.435003 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b podName:3717aa36-be52-423e-ab4d-292c1785b1b4 nodeName:}" failed. No retries permitted until 2026-07-02 16:39:05.434988671 +0000 UTC m=+65.351964179 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c724b" (UniqueName: "kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b") pod "network-check-target-qq7d5" (UID: "3717aa36-be52-423e-ab4d-292c1785b1b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 16:38:33.549343 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:33.549315 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:33.549521 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:33.549433 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s6vg5" podUID="c53fa6ea-2dd2-4c30-b86f-f6a9eca60083" Jul 02 16:38:34.549784 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:34.549750 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:34.550273 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:34.549866 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qq7d5" podUID="3717aa36-be52-423e-ab4d-292c1785b1b4" Jul 02 16:38:34.550273 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:34.549956 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:34.550273 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:34.550126 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:38:34.878215 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:34.878186 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-249.ec2.internal" event="NodeReady" Jul 02 16:38:34.878391 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:34.878362 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 16:38:34.927365 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:34.927331 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p5sz6"] Jul 02 16:38:34.930117 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:34.930094 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zlvhw"] Jul 02 16:38:34.930262 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:34.930221 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p5sz6" Jul 02 16:38:34.931828 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:34.931803 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zlvhw" Jul 02 16:38:34.932419 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:34.932403 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 16:38:34.932569 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:34.932552 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l7cj2\"" Jul 02 16:38:34.932784 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:34.932763 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 16:38:34.933866 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:34.933834 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 16:38:34.934300 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:34.934192 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 16:38:34.934300 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:34.934283 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 16:38:34.934448 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:34.934371 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8mdf8\"" Jul 02 16:38:34.940671 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:34.939896 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p5sz6"] Jul 02 16:38:34.940771 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:34.940680 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zlvhw"] Jul 02 16:38:35.046865 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.046821 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/258ea544-406e-4030-986b-26192845665f-cert\") pod \"ingress-canary-zlvhw\" (UID: \"258ea544-406e-4030-986b-26192845665f\") " pod="openshift-ingress-canary/ingress-canary-zlvhw" Jul 02 16:38:35.046865 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.046863 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d2869e7-896e-4379-85b0-258330cb33eb-tmp-dir\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:38:35.047119 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.046955 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gclzl\" (UniqueName: \"kubernetes.io/projected/258ea544-406e-4030-986b-26192845665f-kube-api-access-gclzl\") pod \"ingress-canary-zlvhw\" (UID: \"258ea544-406e-4030-986b-26192845665f\") " pod="openshift-ingress-canary/ingress-canary-zlvhw" Jul 02 16:38:35.047119 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.046992 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:38:35.047119 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.047063 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d2869e7-896e-4379-85b0-258330cb33eb-config-volume\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:38:35.047119 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.047118 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64mff\" (UniqueName: \"kubernetes.io/projected/3d2869e7-896e-4379-85b0-258330cb33eb-kube-api-access-64mff\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:38:35.148214 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.148120 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gclzl\" (UniqueName: \"kubernetes.io/projected/258ea544-406e-4030-986b-26192845665f-kube-api-access-gclzl\") pod \"ingress-canary-zlvhw\" (UID: \"258ea544-406e-4030-986b-26192845665f\") " pod="openshift-ingress-canary/ingress-canary-zlvhw" Jul 02 16:38:35.148214 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.148172 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:38:35.148442 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.148219 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d2869e7-896e-4379-85b0-258330cb33eb-config-volume\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:38:35.148442 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.148250 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64mff\" (UniqueName: \"kubernetes.io/projected/3d2869e7-896e-4379-85b0-258330cb33eb-kube-api-access-64mff\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:38:35.148442 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:35.148305 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:38:35.148442 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.148326 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/258ea544-406e-4030-986b-26192845665f-cert\") pod \"ingress-canary-zlvhw\" (UID: \"258ea544-406e-4030-986b-26192845665f\") " pod="openshift-ingress-canary/ingress-canary-zlvhw" Jul 02 16:38:35.148442 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.148349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d2869e7-896e-4379-85b0-258330cb33eb-tmp-dir\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:38:35.148442 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:35.148386 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls podName:3d2869e7-896e-4379-85b0-258330cb33eb nodeName:}" failed. No retries permitted until 2026-07-02 16:38:35.648365342 +0000 UTC m=+35.565340848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls") pod "dns-default-p5sz6" (UID: "3d2869e7-896e-4379-85b0-258330cb33eb") : secret "dns-default-metrics-tls" not found Jul 02 16:38:35.148767 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.148702 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d2869e7-896e-4379-85b0-258330cb33eb-tmp-dir\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:38:35.148876 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.148854 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d2869e7-896e-4379-85b0-258330cb33eb-config-volume\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:38:35.153274 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.153248 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/258ea544-406e-4030-986b-26192845665f-cert\") pod \"ingress-canary-zlvhw\" (UID: \"258ea544-406e-4030-986b-26192845665f\") " pod="openshift-ingress-canary/ingress-canary-zlvhw" Jul 02 16:38:35.159246 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.159220 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gclzl\" (UniqueName: \"kubernetes.io/projected/258ea544-406e-4030-986b-26192845665f-kube-api-access-gclzl\") pod \"ingress-canary-zlvhw\" (UID: \"258ea544-406e-4030-986b-26192845665f\") " pod="openshift-ingress-canary/ingress-canary-zlvhw" Jul 02 16:38:35.159377 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.159252 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64mff\" (UniqueName: \"kubernetes.io/projected/3d2869e7-896e-4379-85b0-258330cb33eb-kube-api-access-64mff\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:38:35.249420 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.249381 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zlvhw" Jul 02 16:38:35.549806 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.549731 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:38:35.552195 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.552176 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 16:38:35.652940 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:35.652907 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:38:35.653111 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:35.653088 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:38:35.653182 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:35.653172 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls podName:3d2869e7-896e-4379-85b0-258330cb33eb nodeName:}" failed. No retries permitted until 2026-07-02 16:38:36.653150301 +0000 UTC m=+36.570125812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls") pod "dns-default-p5sz6" (UID: "3d2869e7-896e-4379-85b0-258330cb33eb") : secret "dns-default-metrics-tls" not found Jul 02 16:38:36.175442 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:36.175260 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zlvhw"] Jul 02 16:38:36.178517 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:36.178491 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod258ea544_406e_4030_986b_26192845665f.slice/crio-4b904713ec7f91358d107316136da6e8062f59c9642c79fceb00113a76490bda WatchSource:0}: Error finding container 4b904713ec7f91358d107316136da6e8062f59c9642c79fceb00113a76490bda: Status 404 returned error can't find the container with id 4b904713ec7f91358d107316136da6e8062f59c9642c79fceb00113a76490bda Jul 02 16:38:36.549930 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:36.549839 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:38:36.550644 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:36.549843 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:38:36.552412 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:36.552388 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 16:38:36.552412 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:36.552431 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 16:38:36.552668 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:36.552432 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-krqxp\"" Jul 02 16:38:36.553478 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:36.553447 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j5xkk\"" Jul 02 16:38:36.553478 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:36.553463 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 16:38:36.658407 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:36.658368 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:38:36.658598 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:36.658560 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:38:36.658660 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:36.658633 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls podName:3d2869e7-896e-4379-85b0-258330cb33eb nodeName:}" failed. No retries permitted until 2026-07-02 16:38:38.658617185 +0000 UTC m=+38.575592690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls") pod "dns-default-p5sz6" (UID: "3d2869e7-896e-4379-85b0-258330cb33eb") : secret "dns-default-metrics-tls" not found Jul 02 16:38:36.860531 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:36.860496 2573 generic.go:356] "Generic (PLEG): container finished" podID="156cb232-e7c6-4352-b91f-26673a603734" containerID="f7d41cdc4eb59cafcb8893e204e31212303d2ce562f708910b32806e6d299f0d" exitCode=0 Jul 02 16:38:36.860762 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:36.860569 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zlxgn" event={"ID":"156cb232-e7c6-4352-b91f-26673a603734","Type":"ContainerDied","Data":"f7d41cdc4eb59cafcb8893e204e31212303d2ce562f708910b32806e6d299f0d"} Jul 02 16:38:36.862038 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:36.862011 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zlvhw" event={"ID":"258ea544-406e-4030-986b-26192845665f","Type":"ContainerStarted","Data":"4b904713ec7f91358d107316136da6e8062f59c9642c79fceb00113a76490bda"} Jul 02 16:38:37.868269 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:37.868236 2573 generic.go:356] "Generic (PLEG): container finished" podID="156cb232-e7c6-4352-b91f-26673a603734" containerID="70a78f38c7a3101cf54d395e8fd34d4e3c734a4212ee96e7fda133e5aeabf983" exitCode=0 Jul 02 16:38:37.868717 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:37.868305 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zlxgn" event={"ID":"156cb232-e7c6-4352-b91f-26673a603734","Type":"ContainerDied","Data":"70a78f38c7a3101cf54d395e8fd34d4e3c734a4212ee96e7fda133e5aeabf983"} Jul 02 16:38:38.674117 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:38.674090 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:38:38.674254 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:38.674238 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:38:38.674303 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:38.674296 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls podName:3d2869e7-896e-4379-85b0-258330cb33eb nodeName:}" failed. No retries permitted until 2026-07-02 16:38:42.67428113 +0000 UTC m=+42.591256635 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls") pod "dns-default-p5sz6" (UID: "3d2869e7-896e-4379-85b0-258330cb33eb") : secret "dns-default-metrics-tls" not found Jul 02 16:38:38.875199 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:38.875161 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zlxgn" event={"ID":"156cb232-e7c6-4352-b91f-26673a603734","Type":"ContainerStarted","Data":"c16ce298663d6fd289f293edbcf9c05f33dbd9a20e621df7261442f508bf72fe"} Jul 02 16:38:38.876688 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:38.876657 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zlvhw" event={"ID":"258ea544-406e-4030-986b-26192845665f","Type":"ContainerStarted","Data":"fe48047aac1abd79c51ae226b9ce16fba53ca1c0ce5615934a4ba1fe55773a92"} Jul 02 16:38:38.897278 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:38.897219 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zlxgn" podStartSLOduration=8.632104095 podStartE2EDuration="38.897199743s" totalImagesPullingTime="30.265095648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:38.89586554 +0000 UTC m=+38.812841068" watchObservedRunningTime="2026-07-02 16:38:38.897199743 +0000 UTC m=+38.814175270" Jul 02 16:38:38.909879 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:38.909768 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zlvhw" podStartSLOduration=2.4370447889999998 podStartE2EDuration="4.909748029s" totalImagesPullingTime="2.47270324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:38.909595166 +0000 UTC m=+38.826570693" watchObservedRunningTime="2026-07-02 16:38:38.909748029 +0000 UTC m=+38.826723557" Jul 02 16:38:42.703818 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:42.703633 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:38:42.703818 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:42.703781 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:38:42.704260 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:42.703881 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls podName:3d2869e7-896e-4379-85b0-258330cb33eb nodeName:}" failed. No retries permitted until 2026-07-02 16:38:50.703865987 +0000 UTC m=+50.620841492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls") pod "dns-default-p5sz6" (UID: "3d2869e7-896e-4379-85b0-258330cb33eb") : secret "dns-default-metrics-tls" not found Jul 02 16:38:50.759060 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:50.759019 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:38:50.759570 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:50.759202 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:38:50.759570 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:38:50.759273 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls podName:3d2869e7-896e-4379-85b0-258330cb33eb nodeName:}" failed. No retries permitted until 2026-07-02 16:39:06.759256351 +0000 UTC m=+66.676231856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls") pod "dns-default-p5sz6" (UID: "3d2869e7-896e-4379-85b0-258330cb33eb") : secret "dns-default-metrics-tls" not found Jul 02 16:38:53.994382 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:53.994349 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj"] Jul 02 16:38:54.017001 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.016971 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl"] Jul 02 16:38:54.017190 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.017120 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" Jul 02 16:38:54.019247 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.019221 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 16:38:54.019486 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.019452 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 02 16:38:54.019727 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.019312 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 16:38:54.019727 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.019575 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 16:38:54.029856 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.029833 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj"] Jul 02 16:38:54.029981 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.029870 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl"] Jul 02 16:38:54.029981 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.029970 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.032176 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.032158 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 02 16:38:54.032285 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.032185 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 02 16:38:54.032285 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.032159 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 02 16:38:54.032285 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.032158 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 02 16:38:54.185551 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.185508 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqgqd\" (UniqueName: \"kubernetes.io/projected/4057fab4-4ada-4c34-b164-f318a46690f0-kube-api-access-kqgqd\") pod \"cluster-proxy-proxy-agent-7f86798754-77rwl\" (UID: \"4057fab4-4ada-4c34-b164-f318a46690f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.185718 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.185636 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78c1742c-d65e-4b5d-9c6d-0e558b8abd50-tmp\") pod \"klusterlet-addon-workmgr-786b87cd98-h96xj\" (UID: \"78c1742c-d65e-4b5d-9c6d-0e558b8abd50\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" Jul 02 16:38:54.185718 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.185666 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4057fab4-4ada-4c34-b164-f318a46690f0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f86798754-77rwl\" (UID: \"4057fab4-4ada-4c34-b164-f318a46690f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.185718 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.185695 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt76x\" (UniqueName: \"kubernetes.io/projected/78c1742c-d65e-4b5d-9c6d-0e558b8abd50-kube-api-access-vt76x\") pod \"klusterlet-addon-workmgr-786b87cd98-h96xj\" (UID: \"78c1742c-d65e-4b5d-9c6d-0e558b8abd50\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" Jul 02 16:38:54.185823 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.185715 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4057fab4-4ada-4c34-b164-f318a46690f0-ca\") pod \"cluster-proxy-proxy-agent-7f86798754-77rwl\" (UID: \"4057fab4-4ada-4c34-b164-f318a46690f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.185823 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.185737 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4057fab4-4ada-4c34-b164-f318a46690f0-hub\") pod \"cluster-proxy-proxy-agent-7f86798754-77rwl\" (UID: \"4057fab4-4ada-4c34-b164-f318a46690f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.185823 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.185762 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4057fab4-4ada-4c34-b164-f318a46690f0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f86798754-77rwl\" (UID: \"4057fab4-4ada-4c34-b164-f318a46690f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.185823 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.185783 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4057fab4-4ada-4c34-b164-f318a46690f0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f86798754-77rwl\" (UID: \"4057fab4-4ada-4c34-b164-f318a46690f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.185823 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.185801 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/78c1742c-d65e-4b5d-9c6d-0e558b8abd50-klusterlet-config\") pod \"klusterlet-addon-workmgr-786b87cd98-h96xj\" (UID: \"78c1742c-d65e-4b5d-9c6d-0e558b8abd50\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" Jul 02 16:38:54.287178 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.287097 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78c1742c-d65e-4b5d-9c6d-0e558b8abd50-tmp\") pod \"klusterlet-addon-workmgr-786b87cd98-h96xj\" (UID: \"78c1742c-d65e-4b5d-9c6d-0e558b8abd50\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" Jul 02 16:38:54.287178 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.287129 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4057fab4-4ada-4c34-b164-f318a46690f0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f86798754-77rwl\" (UID: \"4057fab4-4ada-4c34-b164-f318a46690f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.287178 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.287158 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt76x\" (UniqueName: \"kubernetes.io/projected/78c1742c-d65e-4b5d-9c6d-0e558b8abd50-kube-api-access-vt76x\") pod \"klusterlet-addon-workmgr-786b87cd98-h96xj\" (UID: \"78c1742c-d65e-4b5d-9c6d-0e558b8abd50\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" Jul 02 16:38:54.287178 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.287176 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4057fab4-4ada-4c34-b164-f318a46690f0-ca\") pod \"cluster-proxy-proxy-agent-7f86798754-77rwl\" (UID: \"4057fab4-4ada-4c34-b164-f318a46690f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.287488 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.287197 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4057fab4-4ada-4c34-b164-f318a46690f0-hub\") pod \"cluster-proxy-proxy-agent-7f86798754-77rwl\" (UID: \"4057fab4-4ada-4c34-b164-f318a46690f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.287488 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.287221 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4057fab4-4ada-4c34-b164-f318a46690f0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f86798754-77rwl\" (UID: \"4057fab4-4ada-4c34-b164-f318a46690f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.287488 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.287246 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4057fab4-4ada-4c34-b164-f318a46690f0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f86798754-77rwl\" (UID: \"4057fab4-4ada-4c34-b164-f318a46690f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.287488 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.287275 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/78c1742c-d65e-4b5d-9c6d-0e558b8abd50-klusterlet-config\") pod \"klusterlet-addon-workmgr-786b87cd98-h96xj\" (UID: \"78c1742c-d65e-4b5d-9c6d-0e558b8abd50\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" Jul 02 16:38:54.287488 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.287310 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqgqd\" (UniqueName: \"kubernetes.io/projected/4057fab4-4ada-4c34-b164-f318a46690f0-kube-api-access-kqgqd\") pod \"cluster-proxy-proxy-agent-7f86798754-77rwl\" (UID: \"4057fab4-4ada-4c34-b164-f318a46690f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.287712 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.287590 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78c1742c-d65e-4b5d-9c6d-0e558b8abd50-tmp\") pod \"klusterlet-addon-workmgr-786b87cd98-h96xj\" (UID: \"78c1742c-d65e-4b5d-9c6d-0e558b8abd50\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" Jul 02 16:38:54.288116 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.288094 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4057fab4-4ada-4c34-b164-f318a46690f0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f86798754-77rwl\" (UID: \"4057fab4-4ada-4c34-b164-f318a46690f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.291445 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.291413 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4057fab4-4ada-4c34-b164-f318a46690f0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f86798754-77rwl\" (UID: \"4057fab4-4ada-4c34-b164-f318a46690f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.291445 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.291418 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4057fab4-4ada-4c34-b164-f318a46690f0-ca\") pod \"cluster-proxy-proxy-agent-7f86798754-77rwl\" (UID: \"4057fab4-4ada-4c34-b164-f318a46690f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.291621 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.291514 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4057fab4-4ada-4c34-b164-f318a46690f0-hub\") pod \"cluster-proxy-proxy-agent-7f86798754-77rwl\" (UID: \"4057fab4-4ada-4c34-b164-f318a46690f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.291621 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.291524 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4057fab4-4ada-4c34-b164-f318a46690f0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f86798754-77rwl\" (UID: \"4057fab4-4ada-4c34-b164-f318a46690f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.291621 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.291590 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/78c1742c-d65e-4b5d-9c6d-0e558b8abd50-klusterlet-config\") pod \"klusterlet-addon-workmgr-786b87cd98-h96xj\" (UID: \"78c1742c-d65e-4b5d-9c6d-0e558b8abd50\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" Jul 02 16:38:54.295248 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.295224 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqgqd\" (UniqueName: \"kubernetes.io/projected/4057fab4-4ada-4c34-b164-f318a46690f0-kube-api-access-kqgqd\") pod \"cluster-proxy-proxy-agent-7f86798754-77rwl\" (UID: \"4057fab4-4ada-4c34-b164-f318a46690f0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.295424 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.295403 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt76x\" (UniqueName: \"kubernetes.io/projected/78c1742c-d65e-4b5d-9c6d-0e558b8abd50-kube-api-access-vt76x\") pod \"klusterlet-addon-workmgr-786b87cd98-h96xj\" (UID: \"78c1742c-d65e-4b5d-9c6d-0e558b8abd50\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" Jul 02 16:38:54.327229 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.327191 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" Jul 02 16:38:54.350853 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.350827 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:38:54.466416 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.466395 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj"] Jul 02 16:38:54.469455 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:54.469427 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c1742c_d65e_4b5d_9c6d_0e558b8abd50.slice/crio-68f0fb33f8c4865f77629974d39a8bb42fcf8e3b062a121009dcec6000488594 WatchSource:0}: Error finding container 68f0fb33f8c4865f77629974d39a8bb42fcf8e3b062a121009dcec6000488594: Status 404 returned error can't find the container with id 68f0fb33f8c4865f77629974d39a8bb42fcf8e3b062a121009dcec6000488594 Jul 02 16:38:54.489796 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.489639 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl"] Jul 02 16:38:54.492143 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:38:54.492115 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4057fab4_4ada_4c34_b164_f318a46690f0.slice/crio-8ff15aead8750e939a147217cdeaaff5e98fa3e2b55994080c5fc238a3d4c9ca WatchSource:0}: Error finding container 8ff15aead8750e939a147217cdeaaff5e98fa3e2b55994080c5fc238a3d4c9ca: Status 404 returned error can't find the container with id 8ff15aead8750e939a147217cdeaaff5e98fa3e2b55994080c5fc238a3d4c9ca Jul 02 16:38:54.914275 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.914233 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" event={"ID":"78c1742c-d65e-4b5d-9c6d-0e558b8abd50","Type":"ContainerStarted","Data":"68f0fb33f8c4865f77629974d39a8bb42fcf8e3b062a121009dcec6000488594"} Jul 02 16:38:54.915202 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:54.915180 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" event={"ID":"4057fab4-4ada-4c34-b164-f318a46690f0","Type":"ContainerStarted","Data":"8ff15aead8750e939a147217cdeaaff5e98fa3e2b55994080c5fc238a3d4c9ca"} Jul 02 16:38:59.932970 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:59.932926 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" event={"ID":"4057fab4-4ada-4c34-b164-f318a46690f0","Type":"ContainerStarted","Data":"bb3255f2468bca15cd40b365622680609c7fde18cef19a5dd6a5836dd0d447ae"} Jul 02 16:38:59.932970 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:59.932979 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" event={"ID":"4057fab4-4ada-4c34-b164-f318a46690f0","Type":"ContainerStarted","Data":"48e975ce58be517e45672c52384ce36ab58c208a54142f663c66e10bb4569647"} Jul 02 16:38:59.933493 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:59.932992 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" event={"ID":"4057fab4-4ada-4c34-b164-f318a46690f0","Type":"ContainerStarted","Data":"19f6b4f3940b5d011ec274869ef39b8a70bb7f880a5b2cf7717cf06d2182c2f6"} Jul 02 16:38:59.934453 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:59.934429 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" event={"ID":"78c1742c-d65e-4b5d-9c6d-0e558b8abd50","Type":"ContainerStarted","Data":"b55d0f513ca1500b318a91e5443cdd52dd3cd5d925704c7d1dccfb1a5980f38e"} Jul 02 16:38:59.934635 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:59.934621 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" Jul 02 16:38:59.936276 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:59.936255 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" Jul 02 16:38:59.950954 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:59.950905 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" podStartSLOduration=1.87384246 podStartE2EDuration="6.950888312s" totalImagesPullingTime="5.077045852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:59.949726389 +0000 UTC m=+59.866701915" watchObservedRunningTime="2026-07-02 16:38:59.950888312 +0000 UTC m=+59.867863833" Jul 02 16:38:59.967680 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:38:59.967617 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" podStartSLOduration=1.86814579 podStartE2EDuration="6.967594652s" totalImagesPullingTime="5.099448862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:38:59.963639748 +0000 UTC m=+59.880615288" watchObservedRunningTime="2026-07-02 16:38:59.967594652 +0000 UTC m=+59.884570180" Jul 02 16:39:01.850889 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:01.850854 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w9jrc" Jul 02 16:39:05.373026 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:05.372985 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret\") pod \"global-pull-secret-syncer-s6vg5\" (UID: \"c53fa6ea-2dd2-4c30-b86f-f6a9eca60083\") " pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:39:05.373026 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:05.373033 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs\") pod \"network-metrics-daemon-nxkt7\" (UID: \"89ea8114-cf19-48eb-a43f-1ea418757a27\") " pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:39:05.375580 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:05.375556 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 16:39:05.375629 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:05.375556 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 16:39:05.383553 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:39:05.383525 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 16:39:05.383630 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:39:05.383619 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs podName:89ea8114-cf19-48eb-a43f-1ea418757a27 nodeName:}" failed. No retries permitted until 2026-07-02 16:40:09.383601329 +0000 UTC m=+129.300576839 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs") pod "network-metrics-daemon-nxkt7" (UID: "89ea8114-cf19-48eb-a43f-1ea418757a27") : secret "metrics-daemon-secret" not found Jul 02 16:39:05.385689 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:05.385660 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c53fa6ea-2dd2-4c30-b86f-f6a9eca60083-original-pull-secret\") pod \"global-pull-secret-syncer-s6vg5\" (UID: \"c53fa6ea-2dd2-4c30-b86f-f6a9eca60083\") " pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:39:05.473729 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:05.473694 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c724b\" (UniqueName: \"kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b\") pod \"network-check-target-qq7d5\" (UID: \"3717aa36-be52-423e-ab4d-292c1785b1b4\") " pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:39:05.476234 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:05.476216 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 16:39:05.486256 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:05.486230 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 16:39:05.497538 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:05.497498 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c724b\" (UniqueName: \"kubernetes.io/projected/3717aa36-be52-423e-ab4d-292c1785b1b4-kube-api-access-c724b\") pod \"network-check-target-qq7d5\" (UID: \"3717aa36-be52-423e-ab4d-292c1785b1b4\") " pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:39:05.559366 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:05.559330 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s6vg5" Jul 02 16:39:05.662204 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:05.662177 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-krqxp\"" Jul 02 16:39:05.670250 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:05.670221 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:39:05.680912 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:05.680885 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s6vg5"] Jul 02 16:39:05.683823 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:39:05.683786 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc53fa6ea_2dd2_4c30_b86f_f6a9eca60083.slice/crio-d0452d5e5d46da50b3a53586439ad1a0b860a55af76f220437085d695f794b16 WatchSource:0}: Error finding container d0452d5e5d46da50b3a53586439ad1a0b860a55af76f220437085d695f794b16: Status 404 returned error can't find the container with id d0452d5e5d46da50b3a53586439ad1a0b860a55af76f220437085d695f794b16 Jul 02 16:39:05.792742 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:05.792711 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qq7d5"] Jul 02 16:39:05.795865 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:39:05.795841 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3717aa36_be52_423e_ab4d_292c1785b1b4.slice/crio-bc7cad0faa7df3a924f234c3ae000cfb61521f7a3a996a2c7f5e03dd73defdf8 WatchSource:0}: Error finding container bc7cad0faa7df3a924f234c3ae000cfb61521f7a3a996a2c7f5e03dd73defdf8: Status 404 returned error can't find the container with id bc7cad0faa7df3a924f234c3ae000cfb61521f7a3a996a2c7f5e03dd73defdf8 Jul 02 16:39:05.950506 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:05.950400 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s6vg5" event={"ID":"c53fa6ea-2dd2-4c30-b86f-f6a9eca60083","Type":"ContainerStarted","Data":"d0452d5e5d46da50b3a53586439ad1a0b860a55af76f220437085d695f794b16"} Jul 02 16:39:05.951404 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:05.951376 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qq7d5" event={"ID":"3717aa36-be52-423e-ab4d-292c1785b1b4","Type":"ContainerStarted","Data":"bc7cad0faa7df3a924f234c3ae000cfb61521f7a3a996a2c7f5e03dd73defdf8"} Jul 02 16:39:06.785870 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:06.785782 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:39:06.786463 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:39:06.786033 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:39:06.786463 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:39:06.786133 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls podName:3d2869e7-896e-4379-85b0-258330cb33eb nodeName:}" failed. No retries permitted until 2026-07-02 16:39:38.786111235 +0000 UTC m=+98.703086740 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls") pod "dns-default-p5sz6" (UID: "3d2869e7-896e-4379-85b0-258330cb33eb") : secret "dns-default-metrics-tls" not found Jul 02 16:39:10.968262 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:10.968224 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qq7d5" event={"ID":"3717aa36-be52-423e-ab4d-292c1785b1b4","Type":"ContainerStarted","Data":"0c1cdabe549bf812d93ce9b52881ed0247ac6217e24af6257361d24e5dc4ee6d"} Jul 02 16:39:10.968749 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:10.968380 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:39:10.969678 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:10.969652 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s6vg5" event={"ID":"c53fa6ea-2dd2-4c30-b86f-f6a9eca60083","Type":"ContainerStarted","Data":"763d57cb527a77736b68c38fb487f4cca9e347f85f520903c63cafe3fcbe976a"} Jul 02 16:39:10.983864 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:10.983816 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qq7d5" podStartSLOduration=66.349392059 podStartE2EDuration="1m10.983799543s" totalImagesPullingTime="4.634407484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:39:10.982492177 +0000 UTC m=+70.899467696" watchObservedRunningTime="2026-07-02 16:39:10.983799543 +0000 UTC m=+70.900775069" Jul 02 16:39:10.997782 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:10.997732 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s6vg5" podStartSLOduration=66.247212879 podStartE2EDuration="1m10.997715167s" totalImagesPullingTime="4.750502288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:39:10.996839775 +0000 UTC m=+70.913815298" watchObservedRunningTime="2026-07-02 16:39:10.997715167 +0000 UTC m=+70.914690694" Jul 02 16:39:38.813550 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:38.813417 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:39:38.813550 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:39:38.813541 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:39:38.814047 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:39:38.813606 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls podName:3d2869e7-896e-4379-85b0-258330cb33eb nodeName:}" failed. No retries permitted until 2026-07-02 16:40:42.813590531 +0000 UTC m=+162.730566035 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls") pod "dns-default-p5sz6" (UID: "3d2869e7-896e-4379-85b0-258330cb33eb") : secret "dns-default-metrics-tls" not found Jul 02 16:39:41.977233 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:39:41.977202 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qq7d5" Jul 02 16:40:09.424052 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:40:09.423999 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs\") pod \"network-metrics-daemon-nxkt7\" (UID: \"89ea8114-cf19-48eb-a43f-1ea418757a27\") " pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:40:09.424585 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:40:09.424168 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 16:40:09.424585 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:40:09.424248 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs podName:89ea8114-cf19-48eb-a43f-1ea418757a27 nodeName:}" failed. No retries permitted until 2026-07-02 16:42:11.424230073 +0000 UTC m=+251.341205578 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs") pod "network-metrics-daemon-nxkt7" (UID: "89ea8114-cf19-48eb-a43f-1ea418757a27") : secret "metrics-daemon-secret" not found Jul 02 16:40:37.944367 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:40:37.944323 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-p5sz6" podUID="3d2869e7-896e-4379-85b0-258330cb33eb" Jul 02 16:40:38.219620 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:40:38.219537 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p5sz6" Jul 02 16:40:39.565028 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:40:39.564986 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nxkt7" podUID="89ea8114-cf19-48eb-a43f-1ea418757a27" Jul 02 16:40:42.860251 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:40:42.860202 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:40:42.860678 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:40:42.860329 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 16:40:42.860678 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:40:42.860392 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls podName:3d2869e7-896e-4379-85b0-258330cb33eb nodeName:}" failed. No retries permitted until 2026-07-02 16:42:44.860376445 +0000 UTC m=+284.777351949 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls") pod "dns-default-p5sz6" (UID: "3d2869e7-896e-4379-85b0-258330cb33eb") : secret "dns-default-metrics-tls" not found Jul 02 16:40:54.549719 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:40:54.549623 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:40:59.934973 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:40:59.934926 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" podUID="78c1742c-d65e-4b5d-9c6d-0e558b8abd50" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Jul 02 16:41:00.283888 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:00.283855 2573 generic.go:356] "Generic (PLEG): container finished" podID="78c1742c-d65e-4b5d-9c6d-0e558b8abd50" containerID="b55d0f513ca1500b318a91e5443cdd52dd3cd5d925704c7d1dccfb1a5980f38e" exitCode=1 Jul 02 16:41:00.284155 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:00.283935 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" event={"ID":"78c1742c-d65e-4b5d-9c6d-0e558b8abd50","Type":"ContainerDied","Data":"b55d0f513ca1500b318a91e5443cdd52dd3cd5d925704c7d1dccfb1a5980f38e"} Jul 02 16:41:00.284363 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:00.284348 2573 scope.go:117] "RemoveContainer" containerID="b55d0f513ca1500b318a91e5443cdd52dd3cd5d925704c7d1dccfb1a5980f38e" Jul 02 16:41:01.288692 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:01.288656 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" event={"ID":"78c1742c-d65e-4b5d-9c6d-0e558b8abd50","Type":"ContainerStarted","Data":"123daafc6884313dc4728300167e19feca62b93329fde58b4fb849cc3036f3e8"} Jul 02 16:41:01.289125 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:01.288998 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" Jul 02 16:41:01.289632 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:01.289612 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-786b87cd98-h96xj" Jul 02 16:41:44.102832 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.102795 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mnm4n"] Jul 02 16:41:44.104885 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.104860 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:44.107222 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.107197 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 16:41:44.107222 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.107197 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 16:41:44.107408 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.107237 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2cr9q\"" Jul 02 16:41:44.107408 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.107205 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 16:41:44.108051 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.108036 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 16:41:44.116015 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.115975 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mnm4n"] Jul 02 16:41:44.197352 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.197309 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:44.197586 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.197358 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpdc7\" (UniqueName: \"kubernetes.io/projected/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-kube-api-access-dpdc7\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:44.197586 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.197396 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-crio-socket\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:44.197586 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.197419 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:44.197586 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.197461 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-data-volume\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:44.298350 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.298310 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-data-volume\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:44.298521 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.298375 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:44.298521 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.298398 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpdc7\" (UniqueName: \"kubernetes.io/projected/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-kube-api-access-dpdc7\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:44.298521 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.298422 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-crio-socket\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:44.298521 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.298437 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:44.298720 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:41:44.298539 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 16:41:44.298720 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:41:44.298569 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:41:44.298720 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:41:44.298605 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-kube-rbac-proxy-cm podName:b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe nodeName:}" failed. No retries permitted until 2026-07-02 16:41:44.798589396 +0000 UTC m=+224.715564901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mnm4n" (UID: "b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe") : configmap "kube-rbac-proxy" not found Jul 02 16:41:44.298720 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:41:44.298628 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-insights-runtime-extractor-tls podName:b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe nodeName:}" failed. No retries permitted until 2026-07-02 16:41:44.7986141 +0000 UTC m=+224.715589605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mnm4n" (UID: "b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe") : secret "insights-runtime-extractor-tls" not found Jul 02 16:41:44.298720 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.298632 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-crio-socket\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:44.298720 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.298698 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-data-volume\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:44.308642 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.308609 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpdc7\" (UniqueName: \"kubernetes.io/projected/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-kube-api-access-dpdc7\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:44.801881 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.801830 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:44.802081 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:44.801894 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:44.802081 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:41:44.801985 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 16:41:44.802081 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:41:44.802051 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-kube-rbac-proxy-cm podName:b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe nodeName:}" failed. No retries permitted until 2026-07-02 16:41:45.802037175 +0000 UTC m=+225.719012680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mnm4n" (UID: "b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe") : configmap "kube-rbac-proxy" not found Jul 02 16:41:44.802081 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:41:44.801982 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:41:44.802229 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:41:44.802121 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-insights-runtime-extractor-tls podName:b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe nodeName:}" failed. No retries permitted until 2026-07-02 16:41:45.802106054 +0000 UTC m=+225.719081578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mnm4n" (UID: "b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe") : secret "insights-runtime-extractor-tls" not found Jul 02 16:41:45.807644 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:45.807586 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:45.808072 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:41:45.807723 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 16:41:45.808072 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:45.807723 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:45.808072 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:41:45.807795 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-kube-rbac-proxy-cm podName:b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe nodeName:}" failed. No retries permitted until 2026-07-02 16:41:47.807776956 +0000 UTC m=+227.724752481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mnm4n" (UID: "b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe") : configmap "kube-rbac-proxy" not found Jul 02 16:41:45.808072 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:41:45.807803 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:41:45.808072 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:41:45.807843 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-insights-runtime-extractor-tls podName:b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe nodeName:}" failed. No retries permitted until 2026-07-02 16:41:47.807832609 +0000 UTC m=+227.724808119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mnm4n" (UID: "b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe") : secret "insights-runtime-extractor-tls" not found Jul 02 16:41:46.690357 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:46.690330 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-djv7s_a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c/dns-node-resolver/0.log" Jul 02 16:41:47.689783 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:47.689756 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6hb5p_cf010754-1ca0-4088-82fe-281768fbea72/node-ca/0.log" Jul 02 16:41:47.825226 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:47.825193 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:47.825361 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:47.825333 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:47.825450 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:41:47.825438 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:41:47.825531 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:41:47.825521 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-insights-runtime-extractor-tls podName:b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe nodeName:}" failed. No retries permitted until 2026-07-02 16:41:51.825507055 +0000 UTC m=+231.742482560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mnm4n" (UID: "b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe") : secret "insights-runtime-extractor-tls" not found Jul 02 16:41:47.825749 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:47.825733 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:48.890219 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:48.890192 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zlvhw_258ea544-406e-4030-986b-26192845665f/serve-healthcheck-canary/0.log" Jul 02 16:41:51.854921 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:51.854878 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:51.855304 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:41:51.854998 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 16:41:51.855304 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:41:51.855058 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-insights-runtime-extractor-tls podName:b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe nodeName:}" failed. No retries permitted until 2026-07-02 16:41:59.855043624 +0000 UTC m=+239.772019128 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mnm4n" (UID: "b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe") : secret "insights-runtime-extractor-tls" not found Jul 02 16:41:59.913895 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:59.913836 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:41:59.916153 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:41:59.916130 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mnm4n\" (UID: \"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe\") " pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:42:00.014391 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:00.014354 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mnm4n" Jul 02 16:42:00.141776 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:00.141681 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mnm4n"] Jul 02 16:42:00.144586 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:42:00.144556 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96eb3c8_45ed_4c4a_ad0c_9e634d3b05fe.slice/crio-7adeb217454ebb8122c02517b7b82759b4b1a335b390ccf88aeaa0cfc0de7f66 WatchSource:0}: Error finding container 7adeb217454ebb8122c02517b7b82759b4b1a335b390ccf88aeaa0cfc0de7f66: Status 404 returned error can't find the container with id 7adeb217454ebb8122c02517b7b82759b4b1a335b390ccf88aeaa0cfc0de7f66 Jul 02 16:42:00.461796 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:00.461762 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mnm4n" event={"ID":"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe","Type":"ContainerStarted","Data":"7adeb217454ebb8122c02517b7b82759b4b1a335b390ccf88aeaa0cfc0de7f66"} Jul 02 16:42:04.476522 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:04.476462 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mnm4n" event={"ID":"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe","Type":"ContainerStarted","Data":"52717663f1fc124828f4514e13c1f373122c85d427e5c7c37a13d80d712c9a49"} Jul 02 16:42:04.476886 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:04.476575 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mnm4n" event={"ID":"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe","Type":"ContainerStarted","Data":"712583c5d783c4fe89618be4e6315390740a494c884da6c90af43a93df942a8b"} Jul 02 16:42:07.155361 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.155327 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d5f7d45f4-8dmjh"] Jul 02 16:42:07.157166 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.157150 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.159322 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.159300 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 16:42:07.159322 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.159316 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 16:42:07.159519 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.159447 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 16:42:07.160151 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.160106 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bgh7x\"" Jul 02 16:42:07.164916 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.164892 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 16:42:07.173037 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.173011 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d5f7d45f4-8dmjh"] Jul 02 16:42:07.173191 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.173174 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/043bc767-adb6-4d89-bb0d-a453cf56db51-image-registry-private-configuration\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.173245 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.173217 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9trd\" (UniqueName: \"kubernetes.io/projected/043bc767-adb6-4d89-bb0d-a453cf56db51-kube-api-access-l9trd\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.173245 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.173238 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/043bc767-adb6-4d89-bb0d-a453cf56db51-registry-tls\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.173343 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.173259 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/043bc767-adb6-4d89-bb0d-a453cf56db51-ca-trust-extracted\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.173388 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.173334 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/043bc767-adb6-4d89-bb0d-a453cf56db51-trusted-ca\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.173388 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.173376 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/043bc767-adb6-4d89-bb0d-a453cf56db51-bound-sa-token\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.173498 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.173406 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/043bc767-adb6-4d89-bb0d-a453cf56db51-installation-pull-secrets\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.173498 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.173443 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/043bc767-adb6-4d89-bb0d-a453cf56db51-registry-certificates\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.274509 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.274452 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/043bc767-adb6-4d89-bb0d-a453cf56db51-trusted-ca\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.274700 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.274521 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/043bc767-adb6-4d89-bb0d-a453cf56db51-bound-sa-token\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.274700 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.274551 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/043bc767-adb6-4d89-bb0d-a453cf56db51-installation-pull-secrets\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.274700 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.274580 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/043bc767-adb6-4d89-bb0d-a453cf56db51-registry-certificates\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.274700 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.274628 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/043bc767-adb6-4d89-bb0d-a453cf56db51-image-registry-private-configuration\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.274700 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.274684 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9trd\" (UniqueName: \"kubernetes.io/projected/043bc767-adb6-4d89-bb0d-a453cf56db51-kube-api-access-l9trd\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.274945 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.274716 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/043bc767-adb6-4d89-bb0d-a453cf56db51-registry-tls\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.274945 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.274757 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/043bc767-adb6-4d89-bb0d-a453cf56db51-ca-trust-extracted\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.275259 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.275231 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/043bc767-adb6-4d89-bb0d-a453cf56db51-ca-trust-extracted\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.275550 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.275527 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/043bc767-adb6-4d89-bb0d-a453cf56db51-registry-certificates\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.275742 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.275710 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/043bc767-adb6-4d89-bb0d-a453cf56db51-trusted-ca\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.277258 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.277234 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/043bc767-adb6-4d89-bb0d-a453cf56db51-installation-pull-secrets\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.277381 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.277351 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/043bc767-adb6-4d89-bb0d-a453cf56db51-image-registry-private-configuration\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.277429 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.277353 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/043bc767-adb6-4d89-bb0d-a453cf56db51-registry-tls\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.282806 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.282773 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/043bc767-adb6-4d89-bb0d-a453cf56db51-bound-sa-token\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.283359 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.283331 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9trd\" (UniqueName: \"kubernetes.io/projected/043bc767-adb6-4d89-bb0d-a453cf56db51-kube-api-access-l9trd\") pod \"image-registry-d5f7d45f4-8dmjh\" (UID: \"043bc767-adb6-4d89-bb0d-a453cf56db51\") " pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.466854 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.466764 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:07.487766 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.487730 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mnm4n" event={"ID":"b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe","Type":"ContainerStarted","Data":"466e873ecdf7280ea2cb3ccb7176d243e94f251d77148f8aaeba59b2d6de3314"} Jul 02 16:42:07.590380 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.590325 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mnm4n" podStartSLOduration=17.174767686 podStartE2EDuration="23.59030733s" totalImagesPullingTime="6.415539644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:41:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:42:07.503686946 +0000 UTC m=+247.420662474" watchObservedRunningTime="2026-07-02 16:42:07.59030733 +0000 UTC m=+247.507282857" Jul 02 16:42:07.590565 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:07.590549 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d5f7d45f4-8dmjh"] Jul 02 16:42:07.593896 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:42:07.593872 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod043bc767_adb6_4d89_bb0d_a453cf56db51.slice/crio-019cc132277097bfadfc7a69f2c1210ba2b274569146098c98a866168a402425 WatchSource:0}: Error finding container 019cc132277097bfadfc7a69f2c1210ba2b274569146098c98a866168a402425: Status 404 returned error can't find the container with id 019cc132277097bfadfc7a69f2c1210ba2b274569146098c98a866168a402425 Jul 02 16:42:08.492093 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:08.492053 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" event={"ID":"043bc767-adb6-4d89-bb0d-a453cf56db51","Type":"ContainerStarted","Data":"b58f5d7751a6b4cbd7d5277327439be8535c101be9b2fa7f4140a905d35d6d9f"} Jul 02 16:42:08.492507 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:08.492111 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" event={"ID":"043bc767-adb6-4d89-bb0d-a453cf56db51","Type":"ContainerStarted","Data":"019cc132277097bfadfc7a69f2c1210ba2b274569146098c98a866168a402425"} Jul 02 16:42:08.492507 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:08.492210 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:08.511785 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:08.511720 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" podStartSLOduration=1.51170414 podStartE2EDuration="1.51170414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:42:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:42:08.510545759 +0000 UTC m=+248.427521287" watchObservedRunningTime="2026-07-02 16:42:08.51170414 +0000 UTC m=+248.428679667" Jul 02 16:42:11.504968 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:11.504931 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs\") pod \"network-metrics-daemon-nxkt7\" (UID: \"89ea8114-cf19-48eb-a43f-1ea418757a27\") " pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:42:11.507151 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:11.507118 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89ea8114-cf19-48eb-a43f-1ea418757a27-metrics-certs\") pod \"network-metrics-daemon-nxkt7\" (UID: \"89ea8114-cf19-48eb-a43f-1ea418757a27\") " pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:42:11.652895 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:11.652860 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j5xkk\"" Jul 02 16:42:11.661818 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:11.661784 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nxkt7" Jul 02 16:42:11.787430 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:11.787358 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nxkt7"] Jul 02 16:42:11.790054 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:42:11.790025 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ea8114_cf19_48eb_a43f_1ea418757a27.slice/crio-90023de916f5de79671bcbb1769d467ed1c2c76df46054665e8d15ef0d5207c5 WatchSource:0}: Error finding container 90023de916f5de79671bcbb1769d467ed1c2c76df46054665e8d15ef0d5207c5: Status 404 returned error can't find the container with id 90023de916f5de79671bcbb1769d467ed1c2c76df46054665e8d15ef0d5207c5 Jul 02 16:42:12.504606 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:12.504571 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nxkt7" event={"ID":"89ea8114-cf19-48eb-a43f-1ea418757a27","Type":"ContainerStarted","Data":"90023de916f5de79671bcbb1769d467ed1c2c76df46054665e8d15ef0d5207c5"} Jul 02 16:42:13.509702 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:13.509662 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nxkt7" event={"ID":"89ea8114-cf19-48eb-a43f-1ea418757a27","Type":"ContainerStarted","Data":"51fb990bbdfa4abdcc01d058d86a76aeece0ac1184d51e573fa4ad66f2187031"} Jul 02 16:42:13.510093 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:13.509723 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nxkt7" event={"ID":"89ea8114-cf19-48eb-a43f-1ea418757a27","Type":"ContainerStarted","Data":"cbf5eefe6871962cc8fdc8d0e48ae9e9a21398f32ac538e25ba3eee71ee07e88"} Jul 02 16:42:13.523993 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:13.523935 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nxkt7" podStartSLOduration=252.601390804 podStartE2EDuration="4m13.523919055s" totalImagesPullingTime="922.528251ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:42:13.523254212 +0000 UTC m=+253.440229739" watchObservedRunningTime="2026-07-02 16:42:13.523919055 +0000 UTC m=+253.440894581" Jul 02 16:42:22.040947 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.040860 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-vwfv7"] Jul 02 16:42:22.043518 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.043502 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.057131 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.057110 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 16:42:22.057674 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.057660 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 02 16:42:22.057795 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.057784 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 02 16:42:22.057927 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.057916 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 16:42:22.063968 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.063942 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 16:42:22.064109 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.064078 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-t6ch8\"" Jul 02 16:42:22.069878 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.069856 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 02 16:42:22.078586 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.078565 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-vwfv7"] Jul 02 16:42:22.087845 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.087822 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69404e1e-571a-4b44-abd7-707be8dee3f0-metrics-client-ca\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.087970 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.087860 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/69404e1e-571a-4b44-abd7-707be8dee3f0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.087970 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.087888 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/69404e1e-571a-4b44-abd7-707be8dee3f0-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.088077 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.088002 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krfkc\" (UniqueName: \"kubernetes.io/projected/69404e1e-571a-4b44-abd7-707be8dee3f0-kube-api-access-krfkc\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.088077 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.088058 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/69404e1e-571a-4b44-abd7-707be8dee3f0-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.088149 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.088137 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69404e1e-571a-4b44-abd7-707be8dee3f0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.095860 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.095832 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zbpjh"] Jul 02 16:42:22.099117 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.099095 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.101901 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.101874 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 16:42:22.102864 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.102848 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gv5v7\"" Jul 02 16:42:22.102952 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.102867 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 16:42:22.103097 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.103077 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 16:42:22.188775 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.188730 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3635566c-054e-44dd-924c-777e2ca83e63-node-exporter-tls\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.188983 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.188783 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krfkc\" (UniqueName: \"kubernetes.io/projected/69404e1e-571a-4b44-abd7-707be8dee3f0-kube-api-access-krfkc\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.188983 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.188845 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/69404e1e-571a-4b44-abd7-707be8dee3f0-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.188983 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.188884 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3635566c-054e-44dd-924c-777e2ca83e63-metrics-client-ca\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.188983 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.188916 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3635566c-054e-44dd-924c-777e2ca83e63-sys\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.188983 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.188935 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3635566c-054e-44dd-924c-777e2ca83e63-node-exporter-textfile\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.189218 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.188994 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3635566c-054e-44dd-924c-777e2ca83e63-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.189218 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.189018 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69404e1e-571a-4b44-abd7-707be8dee3f0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.189218 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.189058 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3635566c-054e-44dd-924c-777e2ca83e63-root\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.189218 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.189083 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvgnd\" (UniqueName: \"kubernetes.io/projected/3635566c-054e-44dd-924c-777e2ca83e63-kube-api-access-vvgnd\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.189218 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.189114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69404e1e-571a-4b44-abd7-707be8dee3f0-metrics-client-ca\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.189218 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.189139 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/69404e1e-571a-4b44-abd7-707be8dee3f0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.189218 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.189163 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3635566c-054e-44dd-924c-777e2ca83e63-node-exporter-wtmp\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.189218 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.189191 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/69404e1e-571a-4b44-abd7-707be8dee3f0-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.189218 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.189201 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/69404e1e-571a-4b44-abd7-707be8dee3f0-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.189218 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.189219 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3635566c-054e-44dd-924c-777e2ca83e63-node-exporter-accelerators-collector-config\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.189617 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:42:22.189312 2573 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 02 16:42:22.189617 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:42:22.189387 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69404e1e-571a-4b44-abd7-707be8dee3f0-kube-state-metrics-tls podName:69404e1e-571a-4b44-abd7-707be8dee3f0 nodeName:}" failed. No retries permitted until 2026-07-02 16:42:22.689363726 +0000 UTC m=+262.606339241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/69404e1e-571a-4b44-abd7-707be8dee3f0-kube-state-metrics-tls") pod "kube-state-metrics-845b954455-vwfv7" (UID: "69404e1e-571a-4b44-abd7-707be8dee3f0") : secret "kube-state-metrics-tls" not found Jul 02 16:42:22.189801 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.189782 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/69404e1e-571a-4b44-abd7-707be8dee3f0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.189868 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.189851 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69404e1e-571a-4b44-abd7-707be8dee3f0-metrics-client-ca\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.191377 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.191355 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69404e1e-571a-4b44-abd7-707be8dee3f0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.197572 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.197545 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krfkc\" (UniqueName: \"kubernetes.io/projected/69404e1e-571a-4b44-abd7-707be8dee3f0-kube-api-access-krfkc\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.289662 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.289612 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3635566c-054e-44dd-924c-777e2ca83e63-node-exporter-tls\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.289856 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.289680 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3635566c-054e-44dd-924c-777e2ca83e63-metrics-client-ca\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.289856 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.289708 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3635566c-054e-44dd-924c-777e2ca83e63-sys\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.289856 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.289738 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3635566c-054e-44dd-924c-777e2ca83e63-node-exporter-textfile\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.289856 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.289775 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3635566c-054e-44dd-924c-777e2ca83e63-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.289856 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.289816 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3635566c-054e-44dd-924c-777e2ca83e63-root\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.289856 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.289826 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3635566c-054e-44dd-924c-777e2ca83e63-sys\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.289856 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.289838 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvgnd\" (UniqueName: \"kubernetes.io/projected/3635566c-054e-44dd-924c-777e2ca83e63-kube-api-access-vvgnd\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.290204 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.289901 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3635566c-054e-44dd-924c-777e2ca83e63-root\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.290204 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.289964 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3635566c-054e-44dd-924c-777e2ca83e63-node-exporter-wtmp\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.290204 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.290033 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3635566c-054e-44dd-924c-777e2ca83e63-node-exporter-accelerators-collector-config\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.290204 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.290130 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3635566c-054e-44dd-924c-777e2ca83e63-node-exporter-wtmp\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.290204 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.290171 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3635566c-054e-44dd-924c-777e2ca83e63-node-exporter-textfile\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.290505 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.290455 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3635566c-054e-44dd-924c-777e2ca83e63-metrics-client-ca\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.290644 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.290529 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3635566c-054e-44dd-924c-777e2ca83e63-node-exporter-accelerators-collector-config\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.292139 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.292081 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3635566c-054e-44dd-924c-777e2ca83e63-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.292139 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.292129 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3635566c-054e-44dd-924c-777e2ca83e63-node-exporter-tls\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.298511 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.298490 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvgnd\" (UniqueName: \"kubernetes.io/projected/3635566c-054e-44dd-924c-777e2ca83e63-kube-api-access-vvgnd\") pod \"node-exporter-zbpjh\" (UID: \"3635566c-054e-44dd-924c-777e2ca83e63\") " pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.407651 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.407612 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zbpjh" Jul 02 16:42:22.419037 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:42:22.419009 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3635566c_054e_44dd_924c_777e2ca83e63.slice/crio-8ccd4820aab75fa1639de8ceb422dd70ac9966634cd28bbbae2aeefee087bdb3 WatchSource:0}: Error finding container 8ccd4820aab75fa1639de8ceb422dd70ac9966634cd28bbbae2aeefee087bdb3: Status 404 returned error can't find the container with id 8ccd4820aab75fa1639de8ceb422dd70ac9966634cd28bbbae2aeefee087bdb3 Jul 02 16:42:22.539977 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.539932 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zbpjh" event={"ID":"3635566c-054e-44dd-924c-777e2ca83e63","Type":"ContainerStarted","Data":"8ccd4820aab75fa1639de8ceb422dd70ac9966634cd28bbbae2aeefee087bdb3"} Jul 02 16:42:22.692932 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.692896 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/69404e1e-571a-4b44-abd7-707be8dee3f0-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.695284 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.695256 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/69404e1e-571a-4b44-abd7-707be8dee3f0-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-vwfv7\" (UID: \"69404e1e-571a-4b44-abd7-707be8dee3f0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:22.952415 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:22.952328 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" Jul 02 16:42:23.112244 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:23.112214 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-vwfv7"] Jul 02 16:42:23.114844 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:42:23.114806 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69404e1e_571a_4b44_abd7_707be8dee3f0.slice/crio-cd750453acac60b53c1988990d43c9ff99a4a2970d65514e76910e24f15b9c14 WatchSource:0}: Error finding container cd750453acac60b53c1988990d43c9ff99a4a2970d65514e76910e24f15b9c14: Status 404 returned error can't find the container with id cd750453acac60b53c1988990d43c9ff99a4a2970d65514e76910e24f15b9c14 Jul 02 16:42:23.545037 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:23.544985 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zbpjh" event={"ID":"3635566c-054e-44dd-924c-777e2ca83e63","Type":"ContainerStarted","Data":"820e8cc37862ae134db81ffcf21391d130650923e2edbd11b05a49156feaffc6"} Jul 02 16:42:23.546288 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:23.546265 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" event={"ID":"69404e1e-571a-4b44-abd7-707be8dee3f0","Type":"ContainerStarted","Data":"cd750453acac60b53c1988990d43c9ff99a4a2970d65514e76910e24f15b9c14"} Jul 02 16:42:24.551652 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:24.551608 2573 generic.go:356] "Generic (PLEG): container finished" podID="3635566c-054e-44dd-924c-777e2ca83e63" containerID="820e8cc37862ae134db81ffcf21391d130650923e2edbd11b05a49156feaffc6" exitCode=0 Jul 02 16:42:24.553673 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:24.553648 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zbpjh" event={"ID":"3635566c-054e-44dd-924c-777e2ca83e63","Type":"ContainerDied","Data":"820e8cc37862ae134db81ffcf21391d130650923e2edbd11b05a49156feaffc6"} Jul 02 16:42:25.559274 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:25.559240 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zbpjh" event={"ID":"3635566c-054e-44dd-924c-777e2ca83e63","Type":"ContainerStarted","Data":"608c50823f5805922aaef489ce2527b0d7c18c0289c93728c9631ad25b82693d"} Jul 02 16:42:25.559719 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:25.559339 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zbpjh" event={"ID":"3635566c-054e-44dd-924c-777e2ca83e63","Type":"ContainerStarted","Data":"fc47e9d6a3cecf100f8441c01653ea14eee173ba5c130057fe2f52af6cfece86"} Jul 02 16:42:25.561324 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:25.561298 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" event={"ID":"69404e1e-571a-4b44-abd7-707be8dee3f0","Type":"ContainerStarted","Data":"3ffa2b205b1703c13382932844e8a8c921c7d88183cc8f189f9899d25f551a6b"} Jul 02 16:42:25.561449 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:25.561342 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" event={"ID":"69404e1e-571a-4b44-abd7-707be8dee3f0","Type":"ContainerStarted","Data":"dd4e7abe2a154b1fb8e0a97c94ccc50549476a4a10c5e71a0c6c896575303e39"} Jul 02 16:42:25.561449 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:25.561359 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" event={"ID":"69404e1e-571a-4b44-abd7-707be8dee3f0","Type":"ContainerStarted","Data":"8b452393c8a41e38964c1443122f2ac9364d14263bf09097eeed9bc2b96ecf5e"} Jul 02 16:42:25.577678 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:25.577628 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zbpjh" podStartSLOduration=2.5073058120000002 podStartE2EDuration="3.57761374s" totalImagesPullingTime="1.005497395s" totalInitContainerRuntime="64.810533ms" isStatefulPod=true podCreationTimestamp="2026-07-02 16:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:42:25.576507549 +0000 UTC m=+265.493483077" watchObservedRunningTime="2026-07-02 16:42:25.57761374 +0000 UTC m=+265.494589305" Jul 02 16:42:25.592586 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:25.592525 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-vwfv7" podStartSLOduration=2.21709631 podStartE2EDuration="3.592505885s" totalImagesPullingTime="1.375409575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:42:25.591895169 +0000 UTC m=+265.508870709" watchObservedRunningTime="2026-07-02 16:42:25.592505885 +0000 UTC m=+265.509481413" Jul 02 16:42:27.471106 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:27.471058 2573 patch_prober.go:28] interesting pod/image-registry-d5f7d45f4-8dmjh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 16:42:27.471464 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:27.471123 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" podUID="043bc767-adb6-4d89-bb0d-a453cf56db51" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 16:42:29.498922 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:29.498886 2573 patch_prober.go:28] interesting pod/image-registry-d5f7d45f4-8dmjh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 16:42:29.499288 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:29.498944 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" podUID="043bc767-adb6-4d89-bb0d-a453cf56db51" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 16:42:37.471659 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:37.471624 2573 patch_prober.go:28] interesting pod/image-registry-d5f7d45f4-8dmjh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 16:42:37.472055 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:37.471679 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" podUID="043bc767-adb6-4d89-bb0d-a453cf56db51" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 16:42:39.500751 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:39.500718 2573 patch_prober.go:28] interesting pod/image-registry-d5f7d45f4-8dmjh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 16:42:39.501240 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:39.500777 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" podUID="043bc767-adb6-4d89-bb0d-a453cf56db51" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 16:42:41.220552 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:42:41.220499 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-p5sz6" podUID="3d2869e7-896e-4379-85b0-258330cb33eb" Jul 02 16:42:41.611002 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:41.610978 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p5sz6" Jul 02 16:42:44.352092 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:44.352051 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" podUID="4057fab4-4ada-4c34-b164-f318a46690f0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 02 16:42:44.876971 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:44.876935 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:42:44.879263 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:44.879228 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d2869e7-896e-4379-85b0-258330cb33eb-metrics-tls\") pod \"dns-default-p5sz6\" (UID: \"3d2869e7-896e-4379-85b0-258330cb33eb\") " pod="openshift-dns/dns-default-p5sz6" Jul 02 16:42:44.914596 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:44.914566 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l7cj2\"" Jul 02 16:42:44.922602 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:44.922580 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p5sz6" Jul 02 16:42:45.074978 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:45.074954 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p5sz6"] Jul 02 16:42:45.077421 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:42:45.077387 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d2869e7_896e_4379_85b0_258330cb33eb.slice/crio-6cfeb8e5ee74d775fff50be43c8cf0706207623247d751629058b0cfb6d1cf12 WatchSource:0}: Error finding container 6cfeb8e5ee74d775fff50be43c8cf0706207623247d751629058b0cfb6d1cf12: Status 404 returned error can't find the container with id 6cfeb8e5ee74d775fff50be43c8cf0706207623247d751629058b0cfb6d1cf12 Jul 02 16:42:45.624599 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:45.624564 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p5sz6" event={"ID":"3d2869e7-896e-4379-85b0-258330cb33eb","Type":"ContainerStarted","Data":"6cfeb8e5ee74d775fff50be43c8cf0706207623247d751629058b0cfb6d1cf12"} Jul 02 16:42:47.471512 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:47.471459 2573 patch_prober.go:28] interesting pod/image-registry-d5f7d45f4-8dmjh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 16:42:47.471900 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:47.471531 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" podUID="043bc767-adb6-4d89-bb0d-a453cf56db51" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 16:42:47.471900 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:47.471569 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:47.472049 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:47.472006 2573 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"b58f5d7751a6b4cbd7d5277327439be8535c101be9b2fa7f4140a905d35d6d9f"} pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" containerMessage="Container registry failed liveness probe, will be restarted" Jul 02 16:42:47.475653 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:47.475627 2573 patch_prober.go:28] interesting pod/image-registry-d5f7d45f4-8dmjh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 16:42:47.475780 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:47.475671 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" podUID="043bc767-adb6-4d89-bb0d-a453cf56db51" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 16:42:47.635601 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:47.635565 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p5sz6" event={"ID":"3d2869e7-896e-4379-85b0-258330cb33eb","Type":"ContainerStarted","Data":"cedeef8b609e8f6044a9420419248c1a2ed238f12dbf3c7e6fa11c8e89b72fd9"} Jul 02 16:42:47.635801 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:47.635616 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p5sz6" event={"ID":"3d2869e7-896e-4379-85b0-258330cb33eb","Type":"ContainerStarted","Data":"5cae3f60b561e9fa617ffd27faf6c98c337d16de2af3e5ff2b89051c5cd9d20a"} Jul 02 16:42:47.635801 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:47.635697 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p5sz6" Jul 02 16:42:47.652421 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:47.652372 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-p5sz6" podStartSLOduration=252.155177612 podStartE2EDuration="4m13.652356619s" totalImagesPullingTime="1.497179007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:42:47.650201747 +0000 UTC m=+287.567177273" watchObservedRunningTime="2026-07-02 16:42:47.652356619 +0000 UTC m=+287.569332146" Jul 02 16:42:54.352551 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:54.352510 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" podUID="4057fab4-4ada-4c34-b164-f318a46690f0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 02 16:42:57.476510 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:57.476463 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:42:57.641894 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:42:57.641862 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p5sz6" Jul 02 16:43:00.489113 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:43:00.489081 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w9jrc_56c62a91-75b9-497f-8114-278f6da1fcce/ovn-acl-logging/0.log" Jul 02 16:43:00.493607 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:43:00.493575 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w9jrc_56c62a91-75b9-497f-8114-278f6da1fcce/ovn-acl-logging/0.log" Jul 02 16:43:00.494410 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:43:00.494390 2573 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 16:43:04.352271 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:43:04.352230 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" podUID="4057fab4-4ada-4c34-b164-f318a46690f0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 02 16:43:04.353734 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:43:04.352313 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" Jul 02 16:43:04.353734 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:43:04.352809 2573 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"bb3255f2468bca15cd40b365622680609c7fde18cef19a5dd6a5836dd0d447ae"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 02 16:43:04.353734 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:43:04.352852 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" podUID="4057fab4-4ada-4c34-b164-f318a46690f0" containerName="service-proxy" containerID="cri-o://bb3255f2468bca15cd40b365622680609c7fde18cef19a5dd6a5836dd0d447ae" gracePeriod=30 Jul 02 16:43:04.697000 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:43:04.696915 2573 generic.go:356] "Generic (PLEG): container finished" podID="4057fab4-4ada-4c34-b164-f318a46690f0" containerID="bb3255f2468bca15cd40b365622680609c7fde18cef19a5dd6a5836dd0d447ae" exitCode=2 Jul 02 16:43:04.697000 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:43:04.696987 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" event={"ID":"4057fab4-4ada-4c34-b164-f318a46690f0","Type":"ContainerDied","Data":"bb3255f2468bca15cd40b365622680609c7fde18cef19a5dd6a5836dd0d447ae"} Jul 02 16:43:04.697189 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:43:04.697031 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f86798754-77rwl" event={"ID":"4057fab4-4ada-4c34-b164-f318a46690f0","Type":"ContainerStarted","Data":"5a55b104e23d2facb007f6a74980992bd546fd85394a5accf3ce9273aff11b6a"} Jul 02 16:43:12.491589 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:43:12.491537 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" podUID="043bc767-adb6-4d89-bb0d-a453cf56db51" containerName="registry" containerID="cri-o://b58f5d7751a6b4cbd7d5277327439be8535c101be9b2fa7f4140a905d35d6d9f" gracePeriod=30 Jul 02 16:43:13.729449 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:43:13.729414 2573 generic.go:356] "Generic (PLEG): container finished" podID="043bc767-adb6-4d89-bb0d-a453cf56db51" containerID="b58f5d7751a6b4cbd7d5277327439be8535c101be9b2fa7f4140a905d35d6d9f" exitCode=0 Jul 02 16:43:13.729851 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:43:13.729493 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" event={"ID":"043bc767-adb6-4d89-bb0d-a453cf56db51","Type":"ContainerDied","Data":"b58f5d7751a6b4cbd7d5277327439be8535c101be9b2fa7f4140a905d35d6d9f"} Jul 02 16:43:13.729851 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:43:13.729533 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" event={"ID":"043bc767-adb6-4d89-bb0d-a453cf56db51","Type":"ContainerStarted","Data":"6af4b41703f41ca74ec565dad909d5f6fc84117d9bc8059f13c24d9b4f3ce99d"} Jul 02 16:43:13.729851 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:43:13.729601 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:43:34.736555 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:43:34.736528 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d5f7d45f4-8dmjh" Jul 02 16:45:03.999899 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:03.999864 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52"] Jul 02 16:45:04.003056 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:04.003033 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52" Jul 02 16:45:04.005342 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:04.005322 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 16:45:04.006042 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:04.006016 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 16:45:04.006142 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:04.006128 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vs8s7\"" Jul 02 16:45:04.011184 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:04.011160 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52"] Jul 02 16:45:04.107125 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:04.107088 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11884a46-9dff-452b-8b35-bf7331e238a8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52\" (UID: \"11884a46-9dff-452b-8b35-bf7331e238a8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52" Jul 02 16:45:04.107316 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:04.107147 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11884a46-9dff-452b-8b35-bf7331e238a8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52\" (UID: \"11884a46-9dff-452b-8b35-bf7331e238a8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52" Jul 02 16:45:04.107316 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:04.107176 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc4zc\" (UniqueName: \"kubernetes.io/projected/11884a46-9dff-452b-8b35-bf7331e238a8-kube-api-access-tc4zc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52\" (UID: \"11884a46-9dff-452b-8b35-bf7331e238a8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52" Jul 02 16:45:04.208396 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:04.208343 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11884a46-9dff-452b-8b35-bf7331e238a8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52\" (UID: \"11884a46-9dff-452b-8b35-bf7331e238a8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52" Jul 02 16:45:04.208396 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:04.208411 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11884a46-9dff-452b-8b35-bf7331e238a8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52\" (UID: \"11884a46-9dff-452b-8b35-bf7331e238a8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52" Jul 02 16:45:04.208680 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:04.208431 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc4zc\" (UniqueName: \"kubernetes.io/projected/11884a46-9dff-452b-8b35-bf7331e238a8-kube-api-access-tc4zc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52\" (UID: \"11884a46-9dff-452b-8b35-bf7331e238a8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52" Jul 02 16:45:04.208861 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:04.208839 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11884a46-9dff-452b-8b35-bf7331e238a8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52\" (UID: \"11884a46-9dff-452b-8b35-bf7331e238a8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52" Jul 02 16:45:04.208861 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:04.208851 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11884a46-9dff-452b-8b35-bf7331e238a8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52\" (UID: \"11884a46-9dff-452b-8b35-bf7331e238a8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52" Jul 02 16:45:04.218024 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:04.218004 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc4zc\" (UniqueName: \"kubernetes.io/projected/11884a46-9dff-452b-8b35-bf7331e238a8-kube-api-access-tc4zc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52\" (UID: \"11884a46-9dff-452b-8b35-bf7331e238a8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52" Jul 02 16:45:04.312686 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:04.312600 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52" Jul 02 16:45:04.438941 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:04.438908 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52"] Jul 02 16:45:04.442870 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:45:04.442842 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11884a46_9dff_452b_8b35_bf7331e238a8.slice/crio-d993a01fd564066b334d9b68be06028ad40cdc116e75e2773a0003be905291f8 WatchSource:0}: Error finding container d993a01fd564066b334d9b68be06028ad40cdc116e75e2773a0003be905291f8: Status 404 returned error can't find the container with id d993a01fd564066b334d9b68be06028ad40cdc116e75e2773a0003be905291f8 Jul 02 16:45:04.444883 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:04.444867 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 16:45:05.101654 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:05.101616 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52" event={"ID":"11884a46-9dff-452b-8b35-bf7331e238a8","Type":"ContainerStarted","Data":"d993a01fd564066b334d9b68be06028ad40cdc116e75e2773a0003be905291f8"} Jul 02 16:45:14.138156 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:14.138122 2573 generic.go:356] "Generic (PLEG): container finished" podID="11884a46-9dff-452b-8b35-bf7331e238a8" containerID="d747f118b950983c681155c29f5a78c2182ad39471f781a29fa2a4447bd9d882" exitCode=0 Jul 02 16:45:14.138634 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:14.138199 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52" event={"ID":"11884a46-9dff-452b-8b35-bf7331e238a8","Type":"ContainerDied","Data":"d747f118b950983c681155c29f5a78c2182ad39471f781a29fa2a4447bd9d882"} Jul 02 16:45:16.147058 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:16.147027 2573 generic.go:356] "Generic (PLEG): container finished" podID="11884a46-9dff-452b-8b35-bf7331e238a8" containerID="a29d0762fc845a9ab6c361a5a95e3f6adbf5221f03bf0b0d20426f2aef0ba121" exitCode=0 Jul 02 16:45:16.147437 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:16.147115 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52" event={"ID":"11884a46-9dff-452b-8b35-bf7331e238a8","Type":"ContainerDied","Data":"a29d0762fc845a9ab6c361a5a95e3f6adbf5221f03bf0b0d20426f2aef0ba121"} Jul 02 16:45:25.185861 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:25.185829 2573 generic.go:356] "Generic (PLEG): container finished" podID="11884a46-9dff-452b-8b35-bf7331e238a8" containerID="2047a5308e9a7254e3e268f502c95e1e77f108cfd71ced56924d14719c9944b8" exitCode=0 Jul 02 16:45:25.186250 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:25.185880 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52" event={"ID":"11884a46-9dff-452b-8b35-bf7331e238a8","Type":"ContainerDied","Data":"2047a5308e9a7254e3e268f502c95e1e77f108cfd71ced56924d14719c9944b8"} Jul 02 16:45:26.361222 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:26.361185 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52" Jul 02 16:45:26.507045 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:26.506954 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11884a46-9dff-452b-8b35-bf7331e238a8-bundle\") pod \"11884a46-9dff-452b-8b35-bf7331e238a8\" (UID: \"11884a46-9dff-452b-8b35-bf7331e238a8\") " Jul 02 16:45:26.507045 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:26.507028 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc4zc\" (UniqueName: \"kubernetes.io/projected/11884a46-9dff-452b-8b35-bf7331e238a8-kube-api-access-tc4zc\") pod \"11884a46-9dff-452b-8b35-bf7331e238a8\" (UID: \"11884a46-9dff-452b-8b35-bf7331e238a8\") " Jul 02 16:45:26.507228 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:26.507070 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11884a46-9dff-452b-8b35-bf7331e238a8-util\") pod \"11884a46-9dff-452b-8b35-bf7331e238a8\" (UID: \"11884a46-9dff-452b-8b35-bf7331e238a8\") " Jul 02 16:45:26.507840 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:26.507805 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11884a46-9dff-452b-8b35-bf7331e238a8-bundle" (OuterVolumeSpecName: "bundle") pod "11884a46-9dff-452b-8b35-bf7331e238a8" (UID: "11884a46-9dff-452b-8b35-bf7331e238a8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:45:26.509325 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:26.509296 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11884a46-9dff-452b-8b35-bf7331e238a8-kube-api-access-tc4zc" (OuterVolumeSpecName: "kube-api-access-tc4zc") pod "11884a46-9dff-452b-8b35-bf7331e238a8" (UID: "11884a46-9dff-452b-8b35-bf7331e238a8"). InnerVolumeSpecName "kube-api-access-tc4zc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:45:26.512190 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:26.512167 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11884a46-9dff-452b-8b35-bf7331e238a8-util" (OuterVolumeSpecName: "util") pod "11884a46-9dff-452b-8b35-bf7331e238a8" (UID: "11884a46-9dff-452b-8b35-bf7331e238a8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:45:26.608327 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:26.608288 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11884a46-9dff-452b-8b35-bf7331e238a8-bundle\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:45:26.608327 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:26.608319 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc4zc\" (UniqueName: \"kubernetes.io/projected/11884a46-9dff-452b-8b35-bf7331e238a8-kube-api-access-tc4zc\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:45:26.608327 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:26.608329 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11884a46-9dff-452b-8b35-bf7331e238a8-util\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:45:27.197292 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:27.197261 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52" Jul 02 16:45:27.197511 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:27.197267 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wtl52" event={"ID":"11884a46-9dff-452b-8b35-bf7331e238a8","Type":"ContainerDied","Data":"d993a01fd564066b334d9b68be06028ad40cdc116e75e2773a0003be905291f8"} Jul 02 16:45:27.197511 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:45:27.197386 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d993a01fd564066b334d9b68be06028ad40cdc116e75e2773a0003be905291f8" Jul 02 16:46:13.076342 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.076302 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2"] Jul 02 16:46:13.076953 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.076615 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11884a46-9dff-452b-8b35-bf7331e238a8" containerName="pull" Jul 02 16:46:13.076953 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.076633 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="11884a46-9dff-452b-8b35-bf7331e238a8" containerName="pull" Jul 02 16:46:13.076953 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.076649 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11884a46-9dff-452b-8b35-bf7331e238a8" containerName="extract" Jul 02 16:46:13.076953 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.076659 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="11884a46-9dff-452b-8b35-bf7331e238a8" containerName="extract" Jul 02 16:46:13.076953 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.076677 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11884a46-9dff-452b-8b35-bf7331e238a8" containerName="util" Jul 02 16:46:13.076953 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.076684 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="11884a46-9dff-452b-8b35-bf7331e238a8" containerName="util" Jul 02 16:46:13.076953 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.076731 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="11884a46-9dff-452b-8b35-bf7331e238a8" containerName="extract" Jul 02 16:46:13.078731 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.078715 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2" Jul 02 16:46:13.080959 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.080937 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 16:46:13.081093 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.081069 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 16:46:13.082001 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.081983 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vs8s7\"" Jul 02 16:46:13.086568 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.086536 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2"] Jul 02 16:46:13.139083 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.139038 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/253f5664-4bc7-4772-a4f4-4e1e10a1b600-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2\" (UID: \"253f5664-4bc7-4772-a4f4-4e1e10a1b600\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2" Jul 02 16:46:13.139083 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.139086 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/253f5664-4bc7-4772-a4f4-4e1e10a1b600-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2\" (UID: \"253f5664-4bc7-4772-a4f4-4e1e10a1b600\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2" Jul 02 16:46:13.139296 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.139141 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-699mg\" (UniqueName: \"kubernetes.io/projected/253f5664-4bc7-4772-a4f4-4e1e10a1b600-kube-api-access-699mg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2\" (UID: \"253f5664-4bc7-4772-a4f4-4e1e10a1b600\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2" Jul 02 16:46:13.240163 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.240121 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/253f5664-4bc7-4772-a4f4-4e1e10a1b600-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2\" (UID: \"253f5664-4bc7-4772-a4f4-4e1e10a1b600\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2" Jul 02 16:46:13.240368 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.240175 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/253f5664-4bc7-4772-a4f4-4e1e10a1b600-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2\" (UID: \"253f5664-4bc7-4772-a4f4-4e1e10a1b600\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2" Jul 02 16:46:13.240368 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.240213 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-699mg\" (UniqueName: \"kubernetes.io/projected/253f5664-4bc7-4772-a4f4-4e1e10a1b600-kube-api-access-699mg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2\" (UID: \"253f5664-4bc7-4772-a4f4-4e1e10a1b600\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2" Jul 02 16:46:13.240538 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.240516 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/253f5664-4bc7-4772-a4f4-4e1e10a1b600-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2\" (UID: \"253f5664-4bc7-4772-a4f4-4e1e10a1b600\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2" Jul 02 16:46:13.240599 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.240553 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/253f5664-4bc7-4772-a4f4-4e1e10a1b600-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2\" (UID: \"253f5664-4bc7-4772-a4f4-4e1e10a1b600\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2" Jul 02 16:46:13.248177 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.248151 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-699mg\" (UniqueName: \"kubernetes.io/projected/253f5664-4bc7-4772-a4f4-4e1e10a1b600-kube-api-access-699mg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2\" (UID: \"253f5664-4bc7-4772-a4f4-4e1e10a1b600\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2" Jul 02 16:46:13.388420 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.388380 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2" Jul 02 16:46:13.520716 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:13.520690 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2"] Jul 02 16:46:13.523406 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:46:13.523370 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod253f5664_4bc7_4772_a4f4_4e1e10a1b600.slice/crio-991629dcf873e207af20b9b005690e9011a5a29c147f2ed4f3f7b7c7847956fa WatchSource:0}: Error finding container 991629dcf873e207af20b9b005690e9011a5a29c147f2ed4f3f7b7c7847956fa: Status 404 returned error can't find the container with id 991629dcf873e207af20b9b005690e9011a5a29c147f2ed4f3f7b7c7847956fa Jul 02 16:46:14.359521 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:14.359487 2573 generic.go:356] "Generic (PLEG): container finished" podID="253f5664-4bc7-4772-a4f4-4e1e10a1b600" containerID="f281e70fced316a1b5709fdc7df217fbc2fe86a1f038c15daa37546285ff30fd" exitCode=0 Jul 02 16:46:14.359521 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:14.359502 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2" event={"ID":"253f5664-4bc7-4772-a4f4-4e1e10a1b600","Type":"ContainerDied","Data":"f281e70fced316a1b5709fdc7df217fbc2fe86a1f038c15daa37546285ff30fd"} Jul 02 16:46:14.360059 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:14.359548 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2" event={"ID":"253f5664-4bc7-4772-a4f4-4e1e10a1b600","Type":"ContainerStarted","Data":"991629dcf873e207af20b9b005690e9011a5a29c147f2ed4f3f7b7c7847956fa"} Jul 02 16:46:15.364571 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:15.364534 2573 generic.go:356] "Generic (PLEG): container finished" podID="253f5664-4bc7-4772-a4f4-4e1e10a1b600" containerID="d3f6dcf6c48b5cb7fe031cdfdb0c8af079b1f4dd853e66a66bdd0ecf45937e65" exitCode=0 Jul 02 16:46:15.364571 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:15.364573 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2" event={"ID":"253f5664-4bc7-4772-a4f4-4e1e10a1b600","Type":"ContainerDied","Data":"d3f6dcf6c48b5cb7fe031cdfdb0c8af079b1f4dd853e66a66bdd0ecf45937e65"} Jul 02 16:46:16.370223 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:16.370181 2573 generic.go:356] "Generic (PLEG): container finished" podID="253f5664-4bc7-4772-a4f4-4e1e10a1b600" containerID="5fd270c0ae6788ab1da90d4f0280db91605ddbfe731600941ba2f3791661a56a" exitCode=0 Jul 02 16:46:16.370223 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:16.370219 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2" event={"ID":"253f5664-4bc7-4772-a4f4-4e1e10a1b600","Type":"ContainerDied","Data":"5fd270c0ae6788ab1da90d4f0280db91605ddbfe731600941ba2f3791661a56a"} Jul 02 16:46:17.493910 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:17.493885 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2" Jul 02 16:46:17.568673 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:17.568630 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/253f5664-4bc7-4772-a4f4-4e1e10a1b600-util\") pod \"253f5664-4bc7-4772-a4f4-4e1e10a1b600\" (UID: \"253f5664-4bc7-4772-a4f4-4e1e10a1b600\") " Jul 02 16:46:17.568673 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:17.568680 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/253f5664-4bc7-4772-a4f4-4e1e10a1b600-bundle\") pod \"253f5664-4bc7-4772-a4f4-4e1e10a1b600\" (UID: \"253f5664-4bc7-4772-a4f4-4e1e10a1b600\") " Jul 02 16:46:17.568873 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:17.568716 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-699mg\" (UniqueName: \"kubernetes.io/projected/253f5664-4bc7-4772-a4f4-4e1e10a1b600-kube-api-access-699mg\") pod \"253f5664-4bc7-4772-a4f4-4e1e10a1b600\" (UID: \"253f5664-4bc7-4772-a4f4-4e1e10a1b600\") " Jul 02 16:46:17.569406 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:17.569364 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/253f5664-4bc7-4772-a4f4-4e1e10a1b600-bundle" (OuterVolumeSpecName: "bundle") pod "253f5664-4bc7-4772-a4f4-4e1e10a1b600" (UID: "253f5664-4bc7-4772-a4f4-4e1e10a1b600"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:46:17.570794 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:17.570769 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/253f5664-4bc7-4772-a4f4-4e1e10a1b600-kube-api-access-699mg" (OuterVolumeSpecName: "kube-api-access-699mg") pod "253f5664-4bc7-4772-a4f4-4e1e10a1b600" (UID: "253f5664-4bc7-4772-a4f4-4e1e10a1b600"). InnerVolumeSpecName "kube-api-access-699mg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:46:17.576800 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:17.576759 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/253f5664-4bc7-4772-a4f4-4e1e10a1b600-util" (OuterVolumeSpecName: "util") pod "253f5664-4bc7-4772-a4f4-4e1e10a1b600" (UID: "253f5664-4bc7-4772-a4f4-4e1e10a1b600"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:46:17.669412 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:17.669314 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/253f5664-4bc7-4772-a4f4-4e1e10a1b600-util\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:46:17.669412 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:17.669356 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/253f5664-4bc7-4772-a4f4-4e1e10a1b600-bundle\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:46:17.669412 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:17.669366 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-699mg\" (UniqueName: \"kubernetes.io/projected/253f5664-4bc7-4772-a4f4-4e1e10a1b600-kube-api-access-699mg\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:46:18.379256 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:18.379224 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2" event={"ID":"253f5664-4bc7-4772-a4f4-4e1e10a1b600","Type":"ContainerDied","Data":"991629dcf873e207af20b9b005690e9011a5a29c147f2ed4f3f7b7c7847956fa"} Jul 02 16:46:18.379425 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:18.379260 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af77pz2" Jul 02 16:46:18.379425 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:18.379269 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="991629dcf873e207af20b9b005690e9011a5a29c147f2ed4f3f7b7c7847956fa" Jul 02 16:46:26.556133 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.556099 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m"] Jul 02 16:46:26.556733 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.556422 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253f5664-4bc7-4772-a4f4-4e1e10a1b600" containerName="util" Jul 02 16:46:26.556733 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.556439 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="253f5664-4bc7-4772-a4f4-4e1e10a1b600" containerName="util" Jul 02 16:46:26.556733 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.556450 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253f5664-4bc7-4772-a4f4-4e1e10a1b600" containerName="pull" Jul 02 16:46:26.556733 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.556458 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="253f5664-4bc7-4772-a4f4-4e1e10a1b600" containerName="pull" Jul 02 16:46:26.556733 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.556494 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253f5664-4bc7-4772-a4f4-4e1e10a1b600" containerName="extract" Jul 02 16:46:26.556733 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.556504 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="253f5664-4bc7-4772-a4f4-4e1e10a1b600" containerName="extract" Jul 02 16:46:26.556733 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.556579 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="253f5664-4bc7-4772-a4f4-4e1e10a1b600" containerName="extract" Jul 02 16:46:26.558588 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.558568 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:26.560971 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.560946 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 16:46:26.560971 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.560958 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 16:46:26.561143 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.560983 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 16:46:26.561143 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.560992 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 16:46:26.561143 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.560958 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b7pkb\"" Jul 02 16:46:26.573196 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.573169 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m"] Jul 02 16:46:26.635021 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.634979 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95687aed-a1f3-4dea-a633-3c6abdff6d35-webhook-cert\") pod \"opendatahub-operator-controller-manager-6486c9fccb-q7v4m\" (UID: \"95687aed-a1f3-4dea-a633-3c6abdff6d35\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:26.635021 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.635025 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95687aed-a1f3-4dea-a633-3c6abdff6d35-tmp\") pod \"opendatahub-operator-controller-manager-6486c9fccb-q7v4m\" (UID: \"95687aed-a1f3-4dea-a633-3c6abdff6d35\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:26.635230 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.635089 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/95687aed-a1f3-4dea-a633-3c6abdff6d35-manifests\") pod \"opendatahub-operator-controller-manager-6486c9fccb-q7v4m\" (UID: \"95687aed-a1f3-4dea-a633-3c6abdff6d35\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:26.635230 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.635130 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/95687aed-a1f3-4dea-a633-3c6abdff6d35-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6486c9fccb-q7v4m\" (UID: \"95687aed-a1f3-4dea-a633-3c6abdff6d35\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:26.635230 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.635156 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prxv8\" (UniqueName: \"kubernetes.io/projected/95687aed-a1f3-4dea-a633-3c6abdff6d35-kube-api-access-prxv8\") pod \"opendatahub-operator-controller-manager-6486c9fccb-q7v4m\" (UID: \"95687aed-a1f3-4dea-a633-3c6abdff6d35\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:26.735985 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.735949 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prxv8\" (UniqueName: \"kubernetes.io/projected/95687aed-a1f3-4dea-a633-3c6abdff6d35-kube-api-access-prxv8\") pod \"opendatahub-operator-controller-manager-6486c9fccb-q7v4m\" (UID: \"95687aed-a1f3-4dea-a633-3c6abdff6d35\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:26.736180 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.736020 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95687aed-a1f3-4dea-a633-3c6abdff6d35-webhook-cert\") pod \"opendatahub-operator-controller-manager-6486c9fccb-q7v4m\" (UID: \"95687aed-a1f3-4dea-a633-3c6abdff6d35\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:26.736180 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.736066 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95687aed-a1f3-4dea-a633-3c6abdff6d35-tmp\") pod \"opendatahub-operator-controller-manager-6486c9fccb-q7v4m\" (UID: \"95687aed-a1f3-4dea-a633-3c6abdff6d35\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:26.736180 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.736099 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/95687aed-a1f3-4dea-a633-3c6abdff6d35-manifests\") pod \"opendatahub-operator-controller-manager-6486c9fccb-q7v4m\" (UID: \"95687aed-a1f3-4dea-a633-3c6abdff6d35\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:26.736180 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.736127 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/95687aed-a1f3-4dea-a633-3c6abdff6d35-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6486c9fccb-q7v4m\" (UID: \"95687aed-a1f3-4dea-a633-3c6abdff6d35\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:26.736553 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.736531 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/95687aed-a1f3-4dea-a633-3c6abdff6d35-manifests\") pod \"opendatahub-operator-controller-manager-6486c9fccb-q7v4m\" (UID: \"95687aed-a1f3-4dea-a633-3c6abdff6d35\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:26.738390 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.738365 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95687aed-a1f3-4dea-a633-3c6abdff6d35-tmp\") pod \"opendatahub-operator-controller-manager-6486c9fccb-q7v4m\" (UID: \"95687aed-a1f3-4dea-a633-3c6abdff6d35\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:26.738453 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.738432 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95687aed-a1f3-4dea-a633-3c6abdff6d35-webhook-cert\") pod \"opendatahub-operator-controller-manager-6486c9fccb-q7v4m\" (UID: \"95687aed-a1f3-4dea-a633-3c6abdff6d35\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:26.738602 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.738587 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/95687aed-a1f3-4dea-a633-3c6abdff6d35-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6486c9fccb-q7v4m\" (UID: \"95687aed-a1f3-4dea-a633-3c6abdff6d35\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:26.744064 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.744030 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prxv8\" (UniqueName: \"kubernetes.io/projected/95687aed-a1f3-4dea-a633-3c6abdff6d35-kube-api-access-prxv8\") pod \"opendatahub-operator-controller-manager-6486c9fccb-q7v4m\" (UID: \"95687aed-a1f3-4dea-a633-3c6abdff6d35\") " pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:26.868536 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:26.868501 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:27.003463 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:27.003391 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m"] Jul 02 16:46:27.006309 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:46:27.006281 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95687aed_a1f3_4dea_a633_3c6abdff6d35.slice/crio-0194b17d8009faa43cce08f123d7687c784e7126543a3a35112799138278bce0 WatchSource:0}: Error finding container 0194b17d8009faa43cce08f123d7687c784e7126543a3a35112799138278bce0: Status 404 returned error can't find the container with id 0194b17d8009faa43cce08f123d7687c784e7126543a3a35112799138278bce0 Jul 02 16:46:27.412737 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:27.412696 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" event={"ID":"95687aed-a1f3-4dea-a633-3c6abdff6d35","Type":"ContainerStarted","Data":"0194b17d8009faa43cce08f123d7687c784e7126543a3a35112799138278bce0"} Jul 02 16:46:30.427090 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:30.427050 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" event={"ID":"95687aed-a1f3-4dea-a633-3c6abdff6d35","Type":"ContainerStarted","Data":"1f731512a2c9dfd22218e8785ab332268ee004d4887838b834ebd3f41c412f12"} Jul 02 16:46:31.432338 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:31.432305 2573 generic.go:356] "Generic (PLEG): container finished" podID="95687aed-a1f3-4dea-a633-3c6abdff6d35" containerID="1f731512a2c9dfd22218e8785ab332268ee004d4887838b834ebd3f41c412f12" exitCode=0 Jul 02 16:46:31.432338 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:31.432343 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" event={"ID":"95687aed-a1f3-4dea-a633-3c6abdff6d35","Type":"ContainerDied","Data":"1f731512a2c9dfd22218e8785ab332268ee004d4887838b834ebd3f41c412f12"} Jul 02 16:46:32.437656 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:32.437615 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" event={"ID":"95687aed-a1f3-4dea-a633-3c6abdff6d35","Type":"ContainerStarted","Data":"9922aa6344f4927b5e24970d3d365bcf554c0e2eaea260069d3b698940fd3231"} Jul 02 16:46:32.438084 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:32.437721 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:32.460037 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:32.459987 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" podStartSLOduration=1.926885575 podStartE2EDuration="6.459969955s" totalImagesPullingTime="3.439737643s" totalInitContainerRuntime="1.093346737s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:46:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:46:32.459001641 +0000 UTC m=+512.375977169" watchObservedRunningTime="2026-07-02 16:46:32.459969955 +0000 UTC m=+512.376945482" Jul 02 16:46:43.443994 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:43.443967 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6486c9fccb-q7v4m" Jul 02 16:46:48.515557 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.515518 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-cc966699b-qns56"] Jul 02 16:46:48.529616 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.529584 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cc966699b-qns56" Jul 02 16:46:48.532169 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.532137 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 02 16:46:48.532364 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.532173 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 02 16:46:48.532364 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.532188 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 16:46:48.532527 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.532509 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 16:46:48.534948 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.534921 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cc966699b-qns56"] Jul 02 16:46:48.616347 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.616303 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78-tls-certs\") pod \"kube-auth-proxy-cc966699b-qns56\" (UID: \"8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-qns56" Jul 02 16:46:48.616347 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.616346 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78-tmp\") pod \"kube-auth-proxy-cc966699b-qns56\" (UID: \"8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-qns56" Jul 02 16:46:48.616611 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.616376 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh2pf\" (UniqueName: \"kubernetes.io/projected/8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78-kube-api-access-zh2pf\") pod \"kube-auth-proxy-cc966699b-qns56\" (UID: \"8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-qns56" Jul 02 16:46:48.687429 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.687394 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fw2cg"] Jul 02 16:46:48.690032 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.690014 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fw2cg" Jul 02 16:46:48.694022 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.693993 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6gjxp\"" Jul 02 16:46:48.694022 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.694015 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 02 16:46:48.706063 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.705984 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fw2cg"] Jul 02 16:46:48.716977 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.716946 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78-tls-certs\") pod \"kube-auth-proxy-cc966699b-qns56\" (UID: \"8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-qns56" Jul 02 16:46:48.717172 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.716983 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78-tmp\") pod \"kube-auth-proxy-cc966699b-qns56\" (UID: \"8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-qns56" Jul 02 16:46:48.717172 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.717031 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh2pf\" (UniqueName: \"kubernetes.io/projected/8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78-kube-api-access-zh2pf\") pod \"kube-auth-proxy-cc966699b-qns56\" (UID: \"8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-qns56" Jul 02 16:46:48.717172 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:46:48.717112 2573 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 02 16:46:48.717589 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:46:48.717226 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78-tls-certs podName:8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78 nodeName:}" failed. No retries permitted until 2026-07-02 16:46:49.217202169 +0000 UTC m=+529.134177692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78-tls-certs") pod "kube-auth-proxy-cc966699b-qns56" (UID: "8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78") : secret "kube-auth-proxy-tls" not found Jul 02 16:46:48.719998 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.719935 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78-tmp\") pod \"kube-auth-proxy-cc966699b-qns56\" (UID: \"8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-qns56" Jul 02 16:46:48.737392 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.737365 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh2pf\" (UniqueName: \"kubernetes.io/projected/8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78-kube-api-access-zh2pf\") pod \"kube-auth-proxy-cc966699b-qns56\" (UID: \"8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-qns56" Jul 02 16:46:48.817863 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.817761 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05a12bb3-6654-4bb4-9a00-17404c02dc1b-cert\") pod \"odh-model-controller-7998c67dc4-fw2cg\" (UID: \"05a12bb3-6654-4bb4-9a00-17404c02dc1b\") " pod="opendatahub/odh-model-controller-7998c67dc4-fw2cg" Jul 02 16:46:48.817863 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.817818 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj9mm\" (UniqueName: \"kubernetes.io/projected/05a12bb3-6654-4bb4-9a00-17404c02dc1b-kube-api-access-cj9mm\") pod \"odh-model-controller-7998c67dc4-fw2cg\" (UID: \"05a12bb3-6654-4bb4-9a00-17404c02dc1b\") " pod="opendatahub/odh-model-controller-7998c67dc4-fw2cg" Jul 02 16:46:48.918819 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.918775 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05a12bb3-6654-4bb4-9a00-17404c02dc1b-cert\") pod \"odh-model-controller-7998c67dc4-fw2cg\" (UID: \"05a12bb3-6654-4bb4-9a00-17404c02dc1b\") " pod="opendatahub/odh-model-controller-7998c67dc4-fw2cg" Jul 02 16:46:48.918819 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.918821 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj9mm\" (UniqueName: \"kubernetes.io/projected/05a12bb3-6654-4bb4-9a00-17404c02dc1b-kube-api-access-cj9mm\") pod \"odh-model-controller-7998c67dc4-fw2cg\" (UID: \"05a12bb3-6654-4bb4-9a00-17404c02dc1b\") " pod="opendatahub/odh-model-controller-7998c67dc4-fw2cg" Jul 02 16:46:48.919035 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:46:48.918938 2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 02 16:46:48.919035 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:46:48.919002 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05a12bb3-6654-4bb4-9a00-17404c02dc1b-cert podName:05a12bb3-6654-4bb4-9a00-17404c02dc1b nodeName:}" failed. No retries permitted until 2026-07-02 16:46:49.418985224 +0000 UTC m=+529.335960734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/05a12bb3-6654-4bb4-9a00-17404c02dc1b-cert") pod "odh-model-controller-7998c67dc4-fw2cg" (UID: "05a12bb3-6654-4bb4-9a00-17404c02dc1b") : secret "odh-model-controller-webhook-cert" not found Jul 02 16:46:48.927636 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:48.927608 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj9mm\" (UniqueName: \"kubernetes.io/projected/05a12bb3-6654-4bb4-9a00-17404c02dc1b-kube-api-access-cj9mm\") pod \"odh-model-controller-7998c67dc4-fw2cg\" (UID: \"05a12bb3-6654-4bb4-9a00-17404c02dc1b\") " pod="opendatahub/odh-model-controller-7998c67dc4-fw2cg" Jul 02 16:46:49.221738 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.221702 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78-tls-certs\") pod \"kube-auth-proxy-cc966699b-qns56\" (UID: \"8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-qns56" Jul 02 16:46:49.224230 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.224207 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78-tls-certs\") pod \"kube-auth-proxy-cc966699b-qns56\" (UID: \"8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78\") " pod="openshift-ingress/kube-auth-proxy-cc966699b-qns56" Jul 02 16:46:49.423386 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.423347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05a12bb3-6654-4bb4-9a00-17404c02dc1b-cert\") pod \"odh-model-controller-7998c67dc4-fw2cg\" (UID: \"05a12bb3-6654-4bb4-9a00-17404c02dc1b\") " pod="opendatahub/odh-model-controller-7998c67dc4-fw2cg" Jul 02 16:46:49.425929 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.425901 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05a12bb3-6654-4bb4-9a00-17404c02dc1b-cert\") pod \"odh-model-controller-7998c67dc4-fw2cg\" (UID: \"05a12bb3-6654-4bb4-9a00-17404c02dc1b\") " pod="opendatahub/odh-model-controller-7998c67dc4-fw2cg" Jul 02 16:46:49.440719 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.440681 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cc966699b-qns56" Jul 02 16:46:49.594405 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.594380 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cc966699b-qns56"] Jul 02 16:46:49.596730 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:46:49.596699 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b53e79a_3e63_4012_bcc8_4f1f0a3a3a78.slice/crio-ef8bebfde731a0275a660328fe0ff2a0cbf1f1c084798db6e19ffb189983b4aa WatchSource:0}: Error finding container ef8bebfde731a0275a660328fe0ff2a0cbf1f1c084798db6e19ffb189983b4aa: Status 404 returned error can't find the container with id ef8bebfde731a0275a660328fe0ff2a0cbf1f1c084798db6e19ffb189983b4aa Jul 02 16:46:49.601168 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.601053 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fw2cg" Jul 02 16:46:49.729395 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.729370 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fw2cg"] Jul 02 16:46:49.731986 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:46:49.731950 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a12bb3_6654_4bb4_9a00_17404c02dc1b.slice/crio-3c4d7dcde8e111e29ca5b4292aea7108f49cf979a4a90e3ad64be88734195001 WatchSource:0}: Error finding container 3c4d7dcde8e111e29ca5b4292aea7108f49cf979a4a90e3ad64be88734195001: Status 404 returned error can't find the container with id 3c4d7dcde8e111e29ca5b4292aea7108f49cf979a4a90e3ad64be88734195001 Jul 02 16:46:49.790515 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.790406 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd"] Jul 02 16:46:49.793355 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.793333 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:49.797208 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.797188 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 02 16:46:49.797749 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.797728 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 02 16:46:49.797749 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.797748 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 02 16:46:49.797956 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.797764 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 16:46:49.797956 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.797830 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bl4rd\"" Jul 02 16:46:49.806238 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.806217 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd"] Jul 02 16:46:49.927615 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.927576 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:49.927831 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.927627 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/46b71696-2e8f-471a-a028-e21fbdf405d4-local-certs\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:49.927831 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.927709 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:49.927831 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.927754 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-token\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:49.927831 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.927779 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftcw4\" (UniqueName: \"kubernetes.io/projected/46b71696-2e8f-471a-a028-e21fbdf405d4-kube-api-access-ftcw4\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:49.927975 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.927843 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:49.927975 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:49.927902 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/46b71696-2e8f-471a-a028-e21fbdf405d4-cacerts\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:50.028796 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.028757 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:50.028956 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.028815 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/46b71696-2e8f-471a-a028-e21fbdf405d4-local-certs\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:50.028956 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.028855 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:50.028956 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.028892 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-token\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:50.028956 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.028916 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftcw4\" (UniqueName: \"kubernetes.io/projected/46b71696-2e8f-471a-a028-e21fbdf405d4-kube-api-access-ftcw4\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:50.028956 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.028947 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:50.029224 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.029203 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/46b71696-2e8f-471a-a028-e21fbdf405d4-cacerts\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:50.029556 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.029500 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:50.031294 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.031264 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:50.031415 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.031363 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:50.031529 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.031510 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/46b71696-2e8f-471a-a028-e21fbdf405d4-local-certs\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:50.031721 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.031697 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/46b71696-2e8f-471a-a028-e21fbdf405d4-cacerts\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:50.036601 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.036575 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-token\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:50.037085 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.037063 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftcw4\" (UniqueName: \"kubernetes.io/projected/46b71696-2e8f-471a-a028-e21fbdf405d4-kube-api-access-ftcw4\") pod \"istiod-openshift-gateway-7574459656-mj9kd\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:50.103162 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.103114 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:50.249955 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.249922 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd"] Jul 02 16:46:50.253180 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:46:50.253149 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b71696_2e8f_471a_a028_e21fbdf405d4.slice/crio-82b41c3de392a1784a342957f0177a430b751f4eb98a862fdbfcee96fc249968 WatchSource:0}: Error finding container 82b41c3de392a1784a342957f0177a430b751f4eb98a862fdbfcee96fc249968: Status 404 returned error can't find the container with id 82b41c3de392a1784a342957f0177a430b751f4eb98a862fdbfcee96fc249968 Jul 02 16:46:50.508733 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.508591 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cc966699b-qns56" event={"ID":"8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78","Type":"ContainerStarted","Data":"ef8bebfde731a0275a660328fe0ff2a0cbf1f1c084798db6e19ffb189983b4aa"} Jul 02 16:46:50.510308 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.510277 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" event={"ID":"46b71696-2e8f-471a-a028-e21fbdf405d4","Type":"ContainerStarted","Data":"82b41c3de392a1784a342957f0177a430b751f4eb98a862fdbfcee96fc249968"} Jul 02 16:46:50.511691 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:50.511658 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fw2cg" event={"ID":"05a12bb3-6654-4bb4-9a00-17404c02dc1b","Type":"ContainerStarted","Data":"3c4d7dcde8e111e29ca5b4292aea7108f49cf979a4a90e3ad64be88734195001"} Jul 02 16:46:54.370670 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:54.370622 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 16:46:54.371005 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:54.370714 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 16:46:54.532945 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:54.532879 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cc966699b-qns56" event={"ID":"8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78","Type":"ContainerStarted","Data":"cf748d55d28e1e0f0755cc1f42ae2ae454c9e3f76e8f6db6804d90052202514d"} Jul 02 16:46:54.534722 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:54.534690 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" event={"ID":"46b71696-2e8f-471a-a028-e21fbdf405d4","Type":"ContainerStarted","Data":"5cf010b5d1374afd1c1802efa7be68942d157ec577cc675b1c82e78563910736"} Jul 02 16:46:54.534859 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:54.534753 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:54.536566 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:54.536538 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fw2cg" event={"ID":"05a12bb3-6654-4bb4-9a00-17404c02dc1b","Type":"ContainerStarted","Data":"a5717b4decf22a3ba1b1ac114c1e3fabfe608099e9ae32d404f09fab32bebe4e"} Jul 02 16:46:54.536672 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:54.536611 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-fw2cg" Jul 02 16:46:54.549092 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:54.549045 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-cc966699b-qns56" podStartSLOduration=1.7783948550000002 podStartE2EDuration="6.54902988s" totalImagesPullingTime="4.770635025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:46:54.547732294 +0000 UTC m=+534.464707824" watchObservedRunningTime="2026-07-02 16:46:54.54902988 +0000 UTC m=+534.466005460" Jul 02 16:46:54.570851 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:54.570790 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" podStartSLOduration=1.456000763 podStartE2EDuration="5.570775083s" totalImagesPullingTime="4.11477432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:46:54.570026964 +0000 UTC m=+534.487002503" watchObservedRunningTime="2026-07-02 16:46:54.570775083 +0000 UTC m=+534.487750609" Jul 02 16:46:54.586253 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:54.586202 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-fw2cg" podStartSLOduration=1.9389760310000002 podStartE2EDuration="6.586187667s" totalImagesPullingTime="4.647211636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:46:54.585072233 +0000 UTC m=+534.502047785" watchObservedRunningTime="2026-07-02 16:46:54.586187667 +0000 UTC m=+534.503163194" Jul 02 16:46:55.543147 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:55.543116 2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-mj9kd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 16:46:55.543552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:55.543166 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" podUID="46b71696-2e8f-471a-a028-e21fbdf405d4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 16:46:58.497738 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.497698 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2"] Jul 02 16:46:58.500126 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.500098 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" Jul 02 16:46:58.506902 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.506877 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 16:46:58.507022 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.506901 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 16:46:58.507022 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.506928 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 16:46:58.507022 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.506877 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 16:46:58.507304 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.507289 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 16:46:58.511537 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.511520 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-d5cs7\"" Jul 02 16:46:58.531930 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.531900 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2"] Jul 02 16:46:58.542388 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.542363 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:46:58.597721 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.597684 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/416134d9-58f1-4806-a39c-b06bd294eace-metrics-cert\") pod \"lws-controller-manager-5bcdb6898b-twbb2\" (UID: \"416134d9-58f1-4806-a39c-b06bd294eace\") " pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" Jul 02 16:46:58.597898 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.597744 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6dh4\" (UniqueName: \"kubernetes.io/projected/416134d9-58f1-4806-a39c-b06bd294eace-kube-api-access-g6dh4\") pod \"lws-controller-manager-5bcdb6898b-twbb2\" (UID: \"416134d9-58f1-4806-a39c-b06bd294eace\") " pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" Jul 02 16:46:58.597898 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.597821 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/416134d9-58f1-4806-a39c-b06bd294eace-cert\") pod \"lws-controller-manager-5bcdb6898b-twbb2\" (UID: \"416134d9-58f1-4806-a39c-b06bd294eace\") " pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" Jul 02 16:46:58.597898 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.597855 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/416134d9-58f1-4806-a39c-b06bd294eace-manager-config\") pod \"lws-controller-manager-5bcdb6898b-twbb2\" (UID: \"416134d9-58f1-4806-a39c-b06bd294eace\") " pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" Jul 02 16:46:58.698660 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.698623 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/416134d9-58f1-4806-a39c-b06bd294eace-metrics-cert\") pod \"lws-controller-manager-5bcdb6898b-twbb2\" (UID: \"416134d9-58f1-4806-a39c-b06bd294eace\") " pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" Jul 02 16:46:58.698921 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.698889 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6dh4\" (UniqueName: \"kubernetes.io/projected/416134d9-58f1-4806-a39c-b06bd294eace-kube-api-access-g6dh4\") pod \"lws-controller-manager-5bcdb6898b-twbb2\" (UID: \"416134d9-58f1-4806-a39c-b06bd294eace\") " pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" Jul 02 16:46:58.699074 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.698970 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/416134d9-58f1-4806-a39c-b06bd294eace-cert\") pod \"lws-controller-manager-5bcdb6898b-twbb2\" (UID: \"416134d9-58f1-4806-a39c-b06bd294eace\") " pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" Jul 02 16:46:58.699074 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.698999 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/416134d9-58f1-4806-a39c-b06bd294eace-manager-config\") pod \"lws-controller-manager-5bcdb6898b-twbb2\" (UID: \"416134d9-58f1-4806-a39c-b06bd294eace\") " pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" Jul 02 16:46:58.699737 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.699712 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/416134d9-58f1-4806-a39c-b06bd294eace-manager-config\") pod \"lws-controller-manager-5bcdb6898b-twbb2\" (UID: \"416134d9-58f1-4806-a39c-b06bd294eace\") " pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" Jul 02 16:46:58.701235 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.701211 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/416134d9-58f1-4806-a39c-b06bd294eace-metrics-cert\") pod \"lws-controller-manager-5bcdb6898b-twbb2\" (UID: \"416134d9-58f1-4806-a39c-b06bd294eace\") " pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" Jul 02 16:46:58.701363 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.701345 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/416134d9-58f1-4806-a39c-b06bd294eace-cert\") pod \"lws-controller-manager-5bcdb6898b-twbb2\" (UID: \"416134d9-58f1-4806-a39c-b06bd294eace\") " pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" Jul 02 16:46:58.712880 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.712855 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6dh4\" (UniqueName: \"kubernetes.io/projected/416134d9-58f1-4806-a39c-b06bd294eace-kube-api-access-g6dh4\") pod \"lws-controller-manager-5bcdb6898b-twbb2\" (UID: \"416134d9-58f1-4806-a39c-b06bd294eace\") " pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" Jul 02 16:46:58.809127 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.809027 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" Jul 02 16:46:58.944106 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:58.944081 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2"] Jul 02 16:46:58.945806 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:46:58.945779 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod416134d9_58f1_4806_a39c_b06bd294eace.slice/crio-6fcefdf32b9c71f7ef85ffc5252089864cae22e189f27ff90b0b7c9e02055911 WatchSource:0}: Error finding container 6fcefdf32b9c71f7ef85ffc5252089864cae22e189f27ff90b0b7c9e02055911: Status 404 returned error can't find the container with id 6fcefdf32b9c71f7ef85ffc5252089864cae22e189f27ff90b0b7c9e02055911 Jul 02 16:46:59.560628 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:59.560594 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" event={"ID":"416134d9-58f1-4806-a39c-b06bd294eace","Type":"ContainerStarted","Data":"6fcefdf32b9c71f7ef85ffc5252089864cae22e189f27ff90b0b7c9e02055911"} Jul 02 16:46:59.837884 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:59.837855 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd"] Jul 02 16:46:59.838053 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:46:59.838017 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" podUID="46b71696-2e8f-471a-a028-e21fbdf405d4" containerName="discovery" containerID="cri-o://5cf010b5d1374afd1c1802efa7be68942d157ec577cc675b1c82e78563910736" gracePeriod=30 Jul 02 16:47:00.072357 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.072336 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:47:00.211030 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.210936 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-csr-dns-cert\") pod \"46b71696-2e8f-471a-a028-e21fbdf405d4\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " Jul 02 16:47:00.211030 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.210981 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/46b71696-2e8f-471a-a028-e21fbdf405d4-cacerts\") pod \"46b71696-2e8f-471a-a028-e21fbdf405d4\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " Jul 02 16:47:00.211030 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.211012 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftcw4\" (UniqueName: \"kubernetes.io/projected/46b71696-2e8f-471a-a028-e21fbdf405d4-kube-api-access-ftcw4\") pod \"46b71696-2e8f-471a-a028-e21fbdf405d4\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " Jul 02 16:47:00.211030 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.211034 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/46b71696-2e8f-471a-a028-e21fbdf405d4-local-certs\") pod \"46b71696-2e8f-471a-a028-e21fbdf405d4\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " Jul 02 16:47:00.211346 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.211061 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-token\") pod \"46b71696-2e8f-471a-a028-e21fbdf405d4\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " Jul 02 16:47:00.211346 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.211082 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-csr-ca-configmap\") pod \"46b71696-2e8f-471a-a028-e21fbdf405d4\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " Jul 02 16:47:00.211346 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.211098 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-kubeconfig\") pod \"46b71696-2e8f-471a-a028-e21fbdf405d4\" (UID: \"46b71696-2e8f-471a-a028-e21fbdf405d4\") " Jul 02 16:47:00.211614 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.211564 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "46b71696-2e8f-471a-a028-e21fbdf405d4" (UID: "46b71696-2e8f-471a-a028-e21fbdf405d4"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:47:00.213908 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.213871 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "46b71696-2e8f-471a-a028-e21fbdf405d4" (UID: "46b71696-2e8f-471a-a028-e21fbdf405d4"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:47:00.214015 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.213967 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46b71696-2e8f-471a-a028-e21fbdf405d4-local-certs" (OuterVolumeSpecName: "local-certs") pod "46b71696-2e8f-471a-a028-e21fbdf405d4" (UID: "46b71696-2e8f-471a-a028-e21fbdf405d4"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 16:47:00.214015 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.213986 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46b71696-2e8f-471a-a028-e21fbdf405d4-kube-api-access-ftcw4" (OuterVolumeSpecName: "kube-api-access-ftcw4") pod "46b71696-2e8f-471a-a028-e21fbdf405d4" (UID: "46b71696-2e8f-471a-a028-e21fbdf405d4"). InnerVolumeSpecName "kube-api-access-ftcw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:47:00.214015 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.213967 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-token" (OuterVolumeSpecName: "istio-token") pod "46b71696-2e8f-471a-a028-e21fbdf405d4" (UID: "46b71696-2e8f-471a-a028-e21fbdf405d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:47:00.214015 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.213998 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "46b71696-2e8f-471a-a028-e21fbdf405d4" (UID: "46b71696-2e8f-471a-a028-e21fbdf405d4"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:47:00.214152 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.214057 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46b71696-2e8f-471a-a028-e21fbdf405d4-cacerts" (OuterVolumeSpecName: "cacerts") pod "46b71696-2e8f-471a-a028-e21fbdf405d4" (UID: "46b71696-2e8f-471a-a028-e21fbdf405d4"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:47:00.312150 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.312107 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftcw4\" (UniqueName: \"kubernetes.io/projected/46b71696-2e8f-471a-a028-e21fbdf405d4-kube-api-access-ftcw4\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:47:00.312150 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.312141 2573 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/46b71696-2e8f-471a-a028-e21fbdf405d4-local-certs\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:47:00.312150 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.312151 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-token\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:47:00.312150 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.312159 2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-csr-ca-configmap\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:47:00.312413 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.312168 2573 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-kubeconfig\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:47:00.312413 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.312176 2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/46b71696-2e8f-471a-a028-e21fbdf405d4-istio-csr-dns-cert\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:47:00.312413 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.312186 2573 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/46b71696-2e8f-471a-a028-e21fbdf405d4-cacerts\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:47:00.572567 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.572531 2573 generic.go:356] "Generic (PLEG): container finished" podID="46b71696-2e8f-471a-a028-e21fbdf405d4" containerID="5cf010b5d1374afd1c1802efa7be68942d157ec577cc675b1c82e78563910736" exitCode=0 Jul 02 16:47:00.572982 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.572592 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" event={"ID":"46b71696-2e8f-471a-a028-e21fbdf405d4","Type":"ContainerDied","Data":"5cf010b5d1374afd1c1802efa7be68942d157ec577cc675b1c82e78563910736"} Jul 02 16:47:00.572982 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.572867 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" event={"ID":"46b71696-2e8f-471a-a028-e21fbdf405d4","Type":"ContainerDied","Data":"82b41c3de392a1784a342957f0177a430b751f4eb98a862fdbfcee96fc249968"} Jul 02 16:47:00.572982 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.572672 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd" Jul 02 16:47:00.573155 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.572909 2573 scope.go:117] "RemoveContainer" containerID="5cf010b5d1374afd1c1802efa7be68942d157ec577cc675b1c82e78563910736" Jul 02 16:47:00.584272 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.584170 2573 scope.go:117] "RemoveContainer" containerID="5cf010b5d1374afd1c1802efa7be68942d157ec577cc675b1c82e78563910736" Jul 02 16:47:00.584624 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:47:00.584594 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cf010b5d1374afd1c1802efa7be68942d157ec577cc675b1c82e78563910736\": container with ID starting with 5cf010b5d1374afd1c1802efa7be68942d157ec577cc675b1c82e78563910736 not found: ID does not exist" containerID="5cf010b5d1374afd1c1802efa7be68942d157ec577cc675b1c82e78563910736" Jul 02 16:47:00.584708 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.584639 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cf010b5d1374afd1c1802efa7be68942d157ec577cc675b1c82e78563910736"} err="failed to get container status \"5cf010b5d1374afd1c1802efa7be68942d157ec577cc675b1c82e78563910736\": rpc error: code = NotFound desc = could not find container \"5cf010b5d1374afd1c1802efa7be68942d157ec577cc675b1c82e78563910736\": container with ID starting with 5cf010b5d1374afd1c1802efa7be68942d157ec577cc675b1c82e78563910736 not found: ID does not exist" Jul 02 16:47:00.591796 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.591763 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd"] Jul 02 16:47:00.598123 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:00.598098 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mj9kd"] Jul 02 16:47:02.554099 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:02.554011 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46b71696-2e8f-471a-a028-e21fbdf405d4" path="/var/lib/kubelet/pods/46b71696-2e8f-471a-a028-e21fbdf405d4/volumes" Jul 02 16:47:02.584175 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:02.584146 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" event={"ID":"416134d9-58f1-4806-a39c-b06bd294eace","Type":"ContainerStarted","Data":"3d2daa8f652df8b6470d06e5a2d1e4841364e94a090746b8a7f11acae6715946"} Jul 02 16:47:02.584362 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:02.584275 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" Jul 02 16:47:02.600816 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:02.600731 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" podStartSLOduration=1.307155007 podStartE2EDuration="4.600708674s" totalImagesPullingTime="3.293553667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:46:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:47:02.600223871 +0000 UTC m=+542.517199401" watchObservedRunningTime="2026-07-02 16:47:02.600708674 +0000 UTC m=+542.517684203" Jul 02 16:47:05.543122 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:05.543085 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-fw2cg" Jul 02 16:47:13.590497 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:47:13.590450 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5bcdb6898b-twbb2" Jul 02 16:48:00.517773 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:00.517741 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w9jrc_56c62a91-75b9-497f-8114-278f6da1fcce/ovn-acl-logging/0.log" Jul 02 16:48:00.522177 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:00.522154 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w9jrc_56c62a91-75b9-497f-8114-278f6da1fcce/ovn-acl-logging/0.log" Jul 02 16:48:42.708169 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.708135 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-26hmn"] Jul 02 16:48:42.708607 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.708402 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46b71696-2e8f-471a-a028-e21fbdf405d4" containerName="discovery" Jul 02 16:48:42.708607 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.708414 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="46b71696-2e8f-471a-a028-e21fbdf405d4" containerName="discovery" Jul 02 16:48:42.708607 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.708487 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="46b71696-2e8f-471a-a028-e21fbdf405d4" containerName="discovery" Jul 02 16:48:42.710538 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.710516 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-26hmn" Jul 02 16:48:42.712681 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.712651 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 02 16:48:42.712811 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.712746 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 16:48:42.712811 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.712755 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 02 16:48:42.712904 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.712849 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5bktd\"" Jul 02 16:48:42.713923 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.713907 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 16:48:42.718489 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.718442 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-26hmn"] Jul 02 16:48:42.810996 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.810958 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6485255b-11a5-46be-b71c-f68fdf7d0449-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-26hmn\" (UID: \"6485255b-11a5-46be-b71c-f68fdf7d0449\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-26hmn" Jul 02 16:48:42.810996 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.811001 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6485255b-11a5-46be-b71c-f68fdf7d0449-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-26hmn\" (UID: \"6485255b-11a5-46be-b71c-f68fdf7d0449\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-26hmn" Jul 02 16:48:42.811220 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.811023 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhcjq\" (UniqueName: \"kubernetes.io/projected/6485255b-11a5-46be-b71c-f68fdf7d0449-kube-api-access-qhcjq\") pod \"kuadrant-console-plugin-66b5774985-26hmn\" (UID: \"6485255b-11a5-46be-b71c-f68fdf7d0449\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-26hmn" Jul 02 16:48:42.911496 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.911431 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6485255b-11a5-46be-b71c-f68fdf7d0449-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-26hmn\" (UID: \"6485255b-11a5-46be-b71c-f68fdf7d0449\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-26hmn" Jul 02 16:48:42.911496 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.911502 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6485255b-11a5-46be-b71c-f68fdf7d0449-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-26hmn\" (UID: \"6485255b-11a5-46be-b71c-f68fdf7d0449\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-26hmn" Jul 02 16:48:42.911718 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.911535 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhcjq\" (UniqueName: \"kubernetes.io/projected/6485255b-11a5-46be-b71c-f68fdf7d0449-kube-api-access-qhcjq\") pod \"kuadrant-console-plugin-66b5774985-26hmn\" (UID: \"6485255b-11a5-46be-b71c-f68fdf7d0449\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-26hmn" Jul 02 16:48:42.912270 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.912248 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6485255b-11a5-46be-b71c-f68fdf7d0449-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-26hmn\" (UID: \"6485255b-11a5-46be-b71c-f68fdf7d0449\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-26hmn" Jul 02 16:48:42.914049 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.914030 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6485255b-11a5-46be-b71c-f68fdf7d0449-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-26hmn\" (UID: \"6485255b-11a5-46be-b71c-f68fdf7d0449\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-26hmn" Jul 02 16:48:42.919857 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:42.919834 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhcjq\" (UniqueName: \"kubernetes.io/projected/6485255b-11a5-46be-b71c-f68fdf7d0449-kube-api-access-qhcjq\") pod \"kuadrant-console-plugin-66b5774985-26hmn\" (UID: \"6485255b-11a5-46be-b71c-f68fdf7d0449\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-26hmn" Jul 02 16:48:43.020195 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:43.020087 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-26hmn" Jul 02 16:48:43.150171 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:43.150146 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-26hmn"] Jul 02 16:48:43.152522 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:48:43.152490 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6485255b_11a5_46be_b71c_f68fdf7d0449.slice/crio-157a6bb90159e6b0b5f20fb44de1a8b57c8fc013fabd2c7271fd063964a44e5d WatchSource:0}: Error finding container 157a6bb90159e6b0b5f20fb44de1a8b57c8fc013fabd2c7271fd063964a44e5d: Status 404 returned error can't find the container with id 157a6bb90159e6b0b5f20fb44de1a8b57c8fc013fabd2c7271fd063964a44e5d Jul 02 16:48:43.988672 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:48:43.988634 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-26hmn" event={"ID":"6485255b-11a5-46be-b71c-f68fdf7d0449","Type":"ContainerStarted","Data":"157a6bb90159e6b0b5f20fb44de1a8b57c8fc013fabd2c7271fd063964a44e5d"} Jul 02 16:49:06.094848 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:06.094811 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-26hmn" event={"ID":"6485255b-11a5-46be-b71c-f68fdf7d0449","Type":"ContainerStarted","Data":"2ef5afc5c1667614e5d4fc5b7d93e07f0a9d0d53b27ce868f346f33d0dd7daf5"} Jul 02 16:49:06.114372 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:06.114302 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-26hmn" podStartSLOduration=1.933787883 podStartE2EDuration="24.114278741s" totalImagesPullingTime="22.180490858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:49:06.113108907 +0000 UTC m=+666.030084434" watchObservedRunningTime="2026-07-02 16:49:06.114278741 +0000 UTC m=+666.031254268" Jul 02 16:49:38.188099 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.188049 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crg28"] Jul 02 16:49:38.207736 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.207706 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crg28"] Jul 02 16:49:38.207893 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.207820 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-crg28" Jul 02 16:49:38.209911 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.209888 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 02 16:49:38.218242 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.218219 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crg28"] Jul 02 16:49:38.268812 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.268775 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8db180be-0e9b-4497-a46c-c4b8aaad2a04-config-file\") pod \"limitador-limitador-54d6d988d5-crg28\" (UID: \"8db180be-0e9b-4497-a46c-c4b8aaad2a04\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-crg28" Jul 02 16:49:38.268980 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.268822 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb9tr\" (UniqueName: \"kubernetes.io/projected/8db180be-0e9b-4497-a46c-c4b8aaad2a04-kube-api-access-jb9tr\") pod \"limitador-limitador-54d6d988d5-crg28\" (UID: \"8db180be-0e9b-4497-a46c-c4b8aaad2a04\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-crg28" Jul 02 16:49:38.369225 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.369181 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8db180be-0e9b-4497-a46c-c4b8aaad2a04-config-file\") pod \"limitador-limitador-54d6d988d5-crg28\" (UID: \"8db180be-0e9b-4497-a46c-c4b8aaad2a04\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-crg28" Jul 02 16:49:38.369412 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.369246 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb9tr\" (UniqueName: \"kubernetes.io/projected/8db180be-0e9b-4497-a46c-c4b8aaad2a04-kube-api-access-jb9tr\") pod \"limitador-limitador-54d6d988d5-crg28\" (UID: \"8db180be-0e9b-4497-a46c-c4b8aaad2a04\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-crg28" Jul 02 16:49:38.369908 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.369886 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8db180be-0e9b-4497-a46c-c4b8aaad2a04-config-file\") pod \"limitador-limitador-54d6d988d5-crg28\" (UID: \"8db180be-0e9b-4497-a46c-c4b8aaad2a04\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-crg28" Jul 02 16:49:38.381634 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.381605 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb9tr\" (UniqueName: \"kubernetes.io/projected/8db180be-0e9b-4497-a46c-c4b8aaad2a04-kube-api-access-jb9tr\") pod \"limitador-limitador-54d6d988d5-crg28\" (UID: \"8db180be-0e9b-4497-a46c-c4b8aaad2a04\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-crg28" Jul 02 16:49:38.518034 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.517936 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-crg28" Jul 02 16:49:38.619328 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.619297 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-b2rrv"] Jul 02 16:49:38.621575 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.621551 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-b2rrv" Jul 02 16:49:38.623777 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.623752 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-p2z9f\"" Jul 02 16:49:38.630420 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.630394 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-b2rrv"] Jul 02 16:49:38.649976 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.649950 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crg28"] Jul 02 16:49:38.653273 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:49:38.653249 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8db180be_0e9b_4497_a46c_c4b8aaad2a04.slice/crio-a92e5970a92c93b1b5c75b13ab2e70360c30f8f996f6cf52c5619554bea04d19 WatchSource:0}: Error finding container a92e5970a92c93b1b5c75b13ab2e70360c30f8f996f6cf52c5619554bea04d19: Status 404 returned error can't find the container with id a92e5970a92c93b1b5c75b13ab2e70360c30f8f996f6cf52c5619554bea04d19 Jul 02 16:49:38.671699 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.671675 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txcsx\" (UniqueName: \"kubernetes.io/projected/3e6833a9-3698-45a4-9c8b-7d34295dfd30-kube-api-access-txcsx\") pod \"authorino-58cd955675-b2rrv\" (UID: \"3e6833a9-3698-45a4-9c8b-7d34295dfd30\") " pod="kuadrant-system/authorino-58cd955675-b2rrv" Jul 02 16:49:38.726436 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.726401 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-pdphh"] Jul 02 16:49:38.728668 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.728654 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pdphh" Jul 02 16:49:38.736793 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.736768 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pdphh"] Jul 02 16:49:38.772770 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.772676 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2px58\" (UniqueName: \"kubernetes.io/projected/bac72432-2069-4b0f-807d-310274837279-kube-api-access-2px58\") pod \"authorino-75d556bd77-pdphh\" (UID: \"bac72432-2069-4b0f-807d-310274837279\") " pod="kuadrant-system/authorino-75d556bd77-pdphh" Jul 02 16:49:38.772770 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.772740 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txcsx\" (UniqueName: \"kubernetes.io/projected/3e6833a9-3698-45a4-9c8b-7d34295dfd30-kube-api-access-txcsx\") pod \"authorino-58cd955675-b2rrv\" (UID: \"3e6833a9-3698-45a4-9c8b-7d34295dfd30\") " pod="kuadrant-system/authorino-58cd955675-b2rrv" Jul 02 16:49:38.780086 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.780065 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txcsx\" (UniqueName: \"kubernetes.io/projected/3e6833a9-3698-45a4-9c8b-7d34295dfd30-kube-api-access-txcsx\") pod \"authorino-58cd955675-b2rrv\" (UID: \"3e6833a9-3698-45a4-9c8b-7d34295dfd30\") " pod="kuadrant-system/authorino-58cd955675-b2rrv" Jul 02 16:49:38.873903 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.873871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2px58\" (UniqueName: \"kubernetes.io/projected/bac72432-2069-4b0f-807d-310274837279-kube-api-access-2px58\") pod \"authorino-75d556bd77-pdphh\" (UID: \"bac72432-2069-4b0f-807d-310274837279\") " pod="kuadrant-system/authorino-75d556bd77-pdphh" Jul 02 16:49:38.881183 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.881161 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2px58\" (UniqueName: \"kubernetes.io/projected/bac72432-2069-4b0f-807d-310274837279-kube-api-access-2px58\") pod \"authorino-75d556bd77-pdphh\" (UID: \"bac72432-2069-4b0f-807d-310274837279\") " pod="kuadrant-system/authorino-75d556bd77-pdphh" Jul 02 16:49:38.931982 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:38.931945 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-b2rrv" Jul 02 16:49:39.038846 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:39.038771 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pdphh" Jul 02 16:49:39.058864 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:39.058823 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-b2rrv"] Jul 02 16:49:39.062139 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:49:39.062106 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e6833a9_3698_45a4_9c8b_7d34295dfd30.slice/crio-f7756062069753880428d9f8008af71e051beb78258333f1096e8555cb9104af WatchSource:0}: Error finding container f7756062069753880428d9f8008af71e051beb78258333f1096e8555cb9104af: Status 404 returned error can't find the container with id f7756062069753880428d9f8008af71e051beb78258333f1096e8555cb9104af Jul 02 16:49:39.200963 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:39.200900 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pdphh"] Jul 02 16:49:39.206973 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:49:39.206938 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbac72432_2069_4b0f_807d_310274837279.slice/crio-c11b8cbe7e2dae93abc1f3674441bdc6e65a51e892d2eb8741b2bb9f3e0313ff WatchSource:0}: Error finding container c11b8cbe7e2dae93abc1f3674441bdc6e65a51e892d2eb8741b2bb9f3e0313ff: Status 404 returned error can't find the container with id c11b8cbe7e2dae93abc1f3674441bdc6e65a51e892d2eb8741b2bb9f3e0313ff Jul 02 16:49:39.237093 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:39.237049 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pdphh" event={"ID":"bac72432-2069-4b0f-807d-310274837279","Type":"ContainerStarted","Data":"c11b8cbe7e2dae93abc1f3674441bdc6e65a51e892d2eb8741b2bb9f3e0313ff"} Jul 02 16:49:39.242485 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:39.239559 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-crg28" event={"ID":"8db180be-0e9b-4497-a46c-c4b8aaad2a04","Type":"ContainerStarted","Data":"a92e5970a92c93b1b5c75b13ab2e70360c30f8f996f6cf52c5619554bea04d19"} Jul 02 16:49:39.243100 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:39.243066 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-b2rrv" event={"ID":"3e6833a9-3698-45a4-9c8b-7d34295dfd30","Type":"ContainerStarted","Data":"f7756062069753880428d9f8008af71e051beb78258333f1096e8555cb9104af"} Jul 02 16:49:44.276195 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:44.276154 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-crg28" event={"ID":"8db180be-0e9b-4497-a46c-c4b8aaad2a04","Type":"ContainerStarted","Data":"614932945fd7b67583670dbf13c115d9f3ef0c1d9adbe17f093a3f14bd230284"} Jul 02 16:49:44.276768 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:44.276218 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-crg28" Jul 02 16:49:44.277699 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:44.277670 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-b2rrv" event={"ID":"3e6833a9-3698-45a4-9c8b-7d34295dfd30","Type":"ContainerStarted","Data":"033c2ec534b6de4aa443f35fb2cfa819ec03e6001d457e3ef868c980fd2c62ac"} Jul 02 16:49:44.279038 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:44.279017 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pdphh" event={"ID":"bac72432-2069-4b0f-807d-310274837279","Type":"ContainerStarted","Data":"8aa132598b91833179cd6fdc2f35c13f308bb14806a4c20a02609e3b1440c5af"} Jul 02 16:49:44.292803 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:44.292754 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-crg28" podStartSLOduration=1.431034638 podStartE2EDuration="6.292738315s" totalImagesPullingTime="4.861703677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:49:44.291041732 +0000 UTC m=+704.208017260" watchObservedRunningTime="2026-07-02 16:49:44.292738315 +0000 UTC m=+704.209713843" Jul 02 16:49:44.303630 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:44.303581 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-pdphh" podStartSLOduration=2.033217704 podStartE2EDuration="6.303563756s" totalImagesPullingTime="4.270346052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:49:44.302564302 +0000 UTC m=+704.219539843" watchObservedRunningTime="2026-07-02 16:49:44.303563756 +0000 UTC m=+704.220539283" Jul 02 16:49:44.314735 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:44.314686 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-b2rrv" podStartSLOduration=1.870782017 podStartE2EDuration="6.314669193s" totalImagesPullingTime="4.443887176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:49:44.313906973 +0000 UTC m=+704.230882503" watchObservedRunningTime="2026-07-02 16:49:44.314669193 +0000 UTC m=+704.231644719" Jul 02 16:49:44.322170 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:44.322137 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-b2rrv"] Jul 02 16:49:46.287926 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:46.287881 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-b2rrv" podUID="3e6833a9-3698-45a4-9c8b-7d34295dfd30" containerName="authorino" containerID="cri-o://033c2ec534b6de4aa443f35fb2cfa819ec03e6001d457e3ef868c980fd2c62ac" gracePeriod=30 Jul 02 16:49:46.525600 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:46.525577 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-b2rrv" Jul 02 16:49:46.649969 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:46.649936 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txcsx\" (UniqueName: \"kubernetes.io/projected/3e6833a9-3698-45a4-9c8b-7d34295dfd30-kube-api-access-txcsx\") pod \"3e6833a9-3698-45a4-9c8b-7d34295dfd30\" (UID: \"3e6833a9-3698-45a4-9c8b-7d34295dfd30\") " Jul 02 16:49:46.652142 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:46.652108 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e6833a9-3698-45a4-9c8b-7d34295dfd30-kube-api-access-txcsx" (OuterVolumeSpecName: "kube-api-access-txcsx") pod "3e6833a9-3698-45a4-9c8b-7d34295dfd30" (UID: "3e6833a9-3698-45a4-9c8b-7d34295dfd30"). InnerVolumeSpecName "kube-api-access-txcsx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:49:46.751243 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:46.751203 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txcsx\" (UniqueName: \"kubernetes.io/projected/3e6833a9-3698-45a4-9c8b-7d34295dfd30-kube-api-access-txcsx\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:49:47.293225 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:47.293188 2573 generic.go:356] "Generic (PLEG): container finished" podID="3e6833a9-3698-45a4-9c8b-7d34295dfd30" containerID="033c2ec534b6de4aa443f35fb2cfa819ec03e6001d457e3ef868c980fd2c62ac" exitCode=0 Jul 02 16:49:47.293225 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:47.293225 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-b2rrv" Jul 02 16:49:47.293687 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:47.293242 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-b2rrv" event={"ID":"3e6833a9-3698-45a4-9c8b-7d34295dfd30","Type":"ContainerDied","Data":"033c2ec534b6de4aa443f35fb2cfa819ec03e6001d457e3ef868c980fd2c62ac"} Jul 02 16:49:47.293687 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:47.293279 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-b2rrv" event={"ID":"3e6833a9-3698-45a4-9c8b-7d34295dfd30","Type":"ContainerDied","Data":"f7756062069753880428d9f8008af71e051beb78258333f1096e8555cb9104af"} Jul 02 16:49:47.293687 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:47.293299 2573 scope.go:117] "RemoveContainer" containerID="033c2ec534b6de4aa443f35fb2cfa819ec03e6001d457e3ef868c980fd2c62ac" Jul 02 16:49:47.301915 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:47.301896 2573 scope.go:117] "RemoveContainer" containerID="033c2ec534b6de4aa443f35fb2cfa819ec03e6001d457e3ef868c980fd2c62ac" Jul 02 16:49:47.302180 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:49:47.302162 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"033c2ec534b6de4aa443f35fb2cfa819ec03e6001d457e3ef868c980fd2c62ac\": container with ID starting with 033c2ec534b6de4aa443f35fb2cfa819ec03e6001d457e3ef868c980fd2c62ac not found: ID does not exist" containerID="033c2ec534b6de4aa443f35fb2cfa819ec03e6001d457e3ef868c980fd2c62ac" Jul 02 16:49:47.302230 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:47.302191 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"033c2ec534b6de4aa443f35fb2cfa819ec03e6001d457e3ef868c980fd2c62ac"} err="failed to get container status \"033c2ec534b6de4aa443f35fb2cfa819ec03e6001d457e3ef868c980fd2c62ac\": rpc error: code = NotFound desc = could not find container \"033c2ec534b6de4aa443f35fb2cfa819ec03e6001d457e3ef868c980fd2c62ac\": container with ID starting with 033c2ec534b6de4aa443f35fb2cfa819ec03e6001d457e3ef868c980fd2c62ac not found: ID does not exist" Jul 02 16:49:47.312726 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:47.312696 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-b2rrv"] Jul 02 16:49:47.316592 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:47.316571 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-b2rrv"] Jul 02 16:49:48.554906 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:48.554878 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e6833a9-3698-45a4-9c8b-7d34295dfd30" path="/var/lib/kubelet/pods/3e6833a9-3698-45a4-9c8b-7d34295dfd30/volumes" Jul 02 16:49:55.284584 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:49:55.284493 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-crg28" Jul 02 16:51:14.343058 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.343024 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6mfbg"] Jul 02 16:51:14.343579 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.343339 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e6833a9-3698-45a4-9c8b-7d34295dfd30" containerName="authorino" Jul 02 16:51:14.343579 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.343351 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e6833a9-3698-45a4-9c8b-7d34295dfd30" containerName="authorino" Jul 02 16:51:14.343579 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.343406 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e6833a9-3698-45a4-9c8b-7d34295dfd30" containerName="authorino" Jul 02 16:51:14.345626 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.345610 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6mfbg" Jul 02 16:51:14.353885 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.353848 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6mfbg"] Jul 02 16:51:14.424911 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.424870 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk4gv\" (UniqueName: \"kubernetes.io/projected/e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8-kube-api-access-gk4gv\") pod \"authorino-5d4b67c446-6mfbg\" (UID: \"e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8\") " pod="kuadrant-system/authorino-5d4b67c446-6mfbg" Jul 02 16:51:14.525559 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.525519 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk4gv\" (UniqueName: \"kubernetes.io/projected/e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8-kube-api-access-gk4gv\") pod \"authorino-5d4b67c446-6mfbg\" (UID: \"e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8\") " pod="kuadrant-system/authorino-5d4b67c446-6mfbg" Jul 02 16:51:14.533436 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.533411 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk4gv\" (UniqueName: \"kubernetes.io/projected/e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8-kube-api-access-gk4gv\") pod \"authorino-5d4b67c446-6mfbg\" (UID: \"e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8\") " pod="kuadrant-system/authorino-5d4b67c446-6mfbg" Jul 02 16:51:14.585342 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.585308 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6mfbg"] Jul 02 16:51:14.585558 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.585547 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6mfbg" Jul 02 16:51:14.607650 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.607617 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c8c6f7d58-cdwhl"] Jul 02 16:51:14.610127 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.610111 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c8c6f7d58-cdwhl" Jul 02 16:51:14.617857 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.617828 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c8c6f7d58-cdwhl"] Jul 02 16:51:14.715121 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.715086 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6mfbg"] Jul 02 16:51:14.717340 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:51:14.717311 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4f6b9f3_cce8_42e1_b835_f18d13d0f2b8.slice/crio-fccf58b5c4b3a2c3d16eda84de483faa589dbe9f7fcd72154e693e7b19c35b87 WatchSource:0}: Error finding container fccf58b5c4b3a2c3d16eda84de483faa589dbe9f7fcd72154e693e7b19c35b87: Status 404 returned error can't find the container with id fccf58b5c4b3a2c3d16eda84de483faa589dbe9f7fcd72154e693e7b19c35b87 Jul 02 16:51:14.718558 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.718542 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 16:51:14.726513 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.726485 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh5mw\" (UniqueName: \"kubernetes.io/projected/b3dde770-5146-461d-8f40-d71b965ecfa5-kube-api-access-lh5mw\") pod \"authorino-7c8c6f7d58-cdwhl\" (UID: \"b3dde770-5146-461d-8f40-d71b965ecfa5\") " pod="kuadrant-system/authorino-7c8c6f7d58-cdwhl" Jul 02 16:51:14.827526 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.827492 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh5mw\" (UniqueName: \"kubernetes.io/projected/b3dde770-5146-461d-8f40-d71b965ecfa5-kube-api-access-lh5mw\") pod \"authorino-7c8c6f7d58-cdwhl\" (UID: \"b3dde770-5146-461d-8f40-d71b965ecfa5\") " pod="kuadrant-system/authorino-7c8c6f7d58-cdwhl" Jul 02 16:51:14.836012 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.835989 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh5mw\" (UniqueName: \"kubernetes.io/projected/b3dde770-5146-461d-8f40-d71b965ecfa5-kube-api-access-lh5mw\") pod \"authorino-7c8c6f7d58-cdwhl\" (UID: \"b3dde770-5146-461d-8f40-d71b965ecfa5\") " pod="kuadrant-system/authorino-7c8c6f7d58-cdwhl" Jul 02 16:51:14.879349 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.879257 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c8c6f7d58-cdwhl"] Jul 02 16:51:14.879530 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.879495 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c8c6f7d58-cdwhl" Jul 02 16:51:14.903313 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.903279 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c55b6d4fd-vdfzv"] Jul 02 16:51:14.905652 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.905629 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c55b6d4fd-vdfzv" Jul 02 16:51:14.907874 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.907838 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 02 16:51:14.915114 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:14.915087 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c55b6d4fd-vdfzv"] Jul 02 16:51:15.009511 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.009487 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c8c6f7d58-cdwhl"] Jul 02 16:51:15.011788 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:51:15.011753 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3dde770_5146_461d_8f40_d71b965ecfa5.slice/crio-70efd097af6029dd661a34c28efd3b64b5b973c6ddb6f78dbc57f71af8f93967 WatchSource:0}: Error finding container 70efd097af6029dd661a34c28efd3b64b5b973c6ddb6f78dbc57f71af8f93967: Status 404 returned error can't find the container with id 70efd097af6029dd661a34c28efd3b64b5b973c6ddb6f78dbc57f71af8f93967 Jul 02 16:51:15.029607 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.029579 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jljrr\" (UniqueName: \"kubernetes.io/projected/4edc4f2b-f162-43e9-afe6-6f19e6502fa2-kube-api-access-jljrr\") pod \"authorino-5c55b6d4fd-vdfzv\" (UID: \"4edc4f2b-f162-43e9-afe6-6f19e6502fa2\") " pod="kuadrant-system/authorino-5c55b6d4fd-vdfzv" Jul 02 16:51:15.029738 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.029648 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4edc4f2b-f162-43e9-afe6-6f19e6502fa2-tls-cert\") pod \"authorino-5c55b6d4fd-vdfzv\" (UID: \"4edc4f2b-f162-43e9-afe6-6f19e6502fa2\") " pod="kuadrant-system/authorino-5c55b6d4fd-vdfzv" Jul 02 16:51:15.130431 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.130352 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jljrr\" (UniqueName: \"kubernetes.io/projected/4edc4f2b-f162-43e9-afe6-6f19e6502fa2-kube-api-access-jljrr\") pod \"authorino-5c55b6d4fd-vdfzv\" (UID: \"4edc4f2b-f162-43e9-afe6-6f19e6502fa2\") " pod="kuadrant-system/authorino-5c55b6d4fd-vdfzv" Jul 02 16:51:15.130590 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.130504 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4edc4f2b-f162-43e9-afe6-6f19e6502fa2-tls-cert\") pod \"authorino-5c55b6d4fd-vdfzv\" (UID: \"4edc4f2b-f162-43e9-afe6-6f19e6502fa2\") " pod="kuadrant-system/authorino-5c55b6d4fd-vdfzv" Jul 02 16:51:15.132801 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.132781 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4edc4f2b-f162-43e9-afe6-6f19e6502fa2-tls-cert\") pod \"authorino-5c55b6d4fd-vdfzv\" (UID: \"4edc4f2b-f162-43e9-afe6-6f19e6502fa2\") " pod="kuadrant-system/authorino-5c55b6d4fd-vdfzv" Jul 02 16:51:15.137241 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.137219 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jljrr\" (UniqueName: \"kubernetes.io/projected/4edc4f2b-f162-43e9-afe6-6f19e6502fa2-kube-api-access-jljrr\") pod \"authorino-5c55b6d4fd-vdfzv\" (UID: \"4edc4f2b-f162-43e9-afe6-6f19e6502fa2\") " pod="kuadrant-system/authorino-5c55b6d4fd-vdfzv" Jul 02 16:51:15.217256 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.217218 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c55b6d4fd-vdfzv" Jul 02 16:51:15.342562 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.342536 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c55b6d4fd-vdfzv"] Jul 02 16:51:15.345008 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:51:15.344981 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4edc4f2b_f162_43e9_afe6_6f19e6502fa2.slice/crio-6a70f254754206e6d69088e0a1dde9ad037260aeb554170693d85731f02bad9b WatchSource:0}: Error finding container 6a70f254754206e6d69088e0a1dde9ad037260aeb554170693d85731f02bad9b: Status 404 returned error can't find the container with id 6a70f254754206e6d69088e0a1dde9ad037260aeb554170693d85731f02bad9b Jul 02 16:51:15.662057 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.662022 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7c8c6f7d58-cdwhl" podUID="b3dde770-5146-461d-8f40-d71b965ecfa5" containerName="authorino" containerID="cri-o://75d18f637eeb2398bbc762359245f9745f75c3cdf35b5328877fa6fefa7a4dc6" gracePeriod=30 Jul 02 16:51:15.662259 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.662015 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c8c6f7d58-cdwhl" event={"ID":"b3dde770-5146-461d-8f40-d71b965ecfa5","Type":"ContainerStarted","Data":"75d18f637eeb2398bbc762359245f9745f75c3cdf35b5328877fa6fefa7a4dc6"} Jul 02 16:51:15.662259 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.662159 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c8c6f7d58-cdwhl" event={"ID":"b3dde770-5146-461d-8f40-d71b965ecfa5","Type":"ContainerStarted","Data":"70efd097af6029dd661a34c28efd3b64b5b973c6ddb6f78dbc57f71af8f93967"} Jul 02 16:51:15.663716 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.663669 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6mfbg" event={"ID":"e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8","Type":"ContainerStarted","Data":"6d8e791c8efbda90f8fba2bf84685c23f32a3d14c9027a36f67977a40ed4d638"} Jul 02 16:51:15.663716 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.663711 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6mfbg" event={"ID":"e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8","Type":"ContainerStarted","Data":"fccf58b5c4b3a2c3d16eda84de483faa589dbe9f7fcd72154e693e7b19c35b87"} Jul 02 16:51:15.663876 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.663692 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-6mfbg" podUID="e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8" containerName="authorino" containerID="cri-o://6d8e791c8efbda90f8fba2bf84685c23f32a3d14c9027a36f67977a40ed4d638" gracePeriod=30 Jul 02 16:51:15.664944 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.664919 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c55b6d4fd-vdfzv" event={"ID":"4edc4f2b-f162-43e9-afe6-6f19e6502fa2","Type":"ContainerStarted","Data":"6a70f254754206e6d69088e0a1dde9ad037260aeb554170693d85731f02bad9b"} Jul 02 16:51:15.676871 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.676787 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c8c6f7d58-cdwhl" podStartSLOduration=1.263090737 podStartE2EDuration="1.676769249s" totalImagesPullingTime="413.678512ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:51:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:51:15.67522125 +0000 UTC m=+795.592196790" watchObservedRunningTime="2026-07-02 16:51:15.676769249 +0000 UTC m=+795.593744775" Jul 02 16:51:15.690491 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.690418 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-6mfbg" podStartSLOduration=1.334822676 podStartE2EDuration="1.690403609s" totalImagesPullingTime="355.580933ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:51:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:51:15.689661448 +0000 UTC m=+795.606636970" watchObservedRunningTime="2026-07-02 16:51:15.690403609 +0000 UTC m=+795.607379135" Jul 02 16:51:15.928817 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.928753 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6mfbg" Jul 02 16:51:15.933649 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:15.933627 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c8c6f7d58-cdwhl" Jul 02 16:51:16.039238 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.039200 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gk4gv\" (UniqueName: \"kubernetes.io/projected/e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8-kube-api-access-gk4gv\") pod \"e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8\" (UID: \"e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8\") " Jul 02 16:51:16.039238 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.039245 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lh5mw\" (UniqueName: \"kubernetes.io/projected/b3dde770-5146-461d-8f40-d71b965ecfa5-kube-api-access-lh5mw\") pod \"b3dde770-5146-461d-8f40-d71b965ecfa5\" (UID: \"b3dde770-5146-461d-8f40-d71b965ecfa5\") " Jul 02 16:51:16.041434 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.041407 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3dde770-5146-461d-8f40-d71b965ecfa5-kube-api-access-lh5mw" (OuterVolumeSpecName: "kube-api-access-lh5mw") pod "b3dde770-5146-461d-8f40-d71b965ecfa5" (UID: "b3dde770-5146-461d-8f40-d71b965ecfa5"). InnerVolumeSpecName "kube-api-access-lh5mw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:51:16.041434 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.041415 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8-kube-api-access-gk4gv" (OuterVolumeSpecName: "kube-api-access-gk4gv") pod "e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8" (UID: "e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8"). InnerVolumeSpecName "kube-api-access-gk4gv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:51:16.140307 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.140270 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lh5mw\" (UniqueName: \"kubernetes.io/projected/b3dde770-5146-461d-8f40-d71b965ecfa5-kube-api-access-lh5mw\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:51:16.140307 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.140301 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gk4gv\" (UniqueName: \"kubernetes.io/projected/e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8-kube-api-access-gk4gv\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:51:16.670451 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.670413 2573 generic.go:356] "Generic (PLEG): container finished" podID="e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8" containerID="6d8e791c8efbda90f8fba2bf84685c23f32a3d14c9027a36f67977a40ed4d638" exitCode=0 Jul 02 16:51:16.670940 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.670460 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6mfbg" Jul 02 16:51:16.670940 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.670507 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6mfbg" event={"ID":"e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8","Type":"ContainerDied","Data":"6d8e791c8efbda90f8fba2bf84685c23f32a3d14c9027a36f67977a40ed4d638"} Jul 02 16:51:16.670940 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.670548 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6mfbg" event={"ID":"e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8","Type":"ContainerDied","Data":"fccf58b5c4b3a2c3d16eda84de483faa589dbe9f7fcd72154e693e7b19c35b87"} Jul 02 16:51:16.670940 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.670565 2573 scope.go:117] "RemoveContainer" containerID="6d8e791c8efbda90f8fba2bf84685c23f32a3d14c9027a36f67977a40ed4d638" Jul 02 16:51:16.672325 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.672295 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c55b6d4fd-vdfzv" event={"ID":"4edc4f2b-f162-43e9-afe6-6f19e6502fa2","Type":"ContainerStarted","Data":"0623bbbb7b48c628927bc3061133b43f75a5a1ac6a6e4e69fbda80a876b2a01b"} Jul 02 16:51:16.673685 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.673662 2573 generic.go:356] "Generic (PLEG): container finished" podID="b3dde770-5146-461d-8f40-d71b965ecfa5" containerID="75d18f637eeb2398bbc762359245f9745f75c3cdf35b5328877fa6fefa7a4dc6" exitCode=0 Jul 02 16:51:16.673806 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.673701 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c8c6f7d58-cdwhl" Jul 02 16:51:16.673806 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.673735 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c8c6f7d58-cdwhl" event={"ID":"b3dde770-5146-461d-8f40-d71b965ecfa5","Type":"ContainerDied","Data":"75d18f637eeb2398bbc762359245f9745f75c3cdf35b5328877fa6fefa7a4dc6"} Jul 02 16:51:16.673806 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.673765 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c8c6f7d58-cdwhl" event={"ID":"b3dde770-5146-461d-8f40-d71b965ecfa5","Type":"ContainerDied","Data":"70efd097af6029dd661a34c28efd3b64b5b973c6ddb6f78dbc57f71af8f93967"} Jul 02 16:51:16.679445 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.679427 2573 scope.go:117] "RemoveContainer" containerID="6d8e791c8efbda90f8fba2bf84685c23f32a3d14c9027a36f67977a40ed4d638" Jul 02 16:51:16.679741 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:51:16.679722 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d8e791c8efbda90f8fba2bf84685c23f32a3d14c9027a36f67977a40ed4d638\": container with ID starting with 6d8e791c8efbda90f8fba2bf84685c23f32a3d14c9027a36f67977a40ed4d638 not found: ID does not exist" containerID="6d8e791c8efbda90f8fba2bf84685c23f32a3d14c9027a36f67977a40ed4d638" Jul 02 16:51:16.679790 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.679749 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d8e791c8efbda90f8fba2bf84685c23f32a3d14c9027a36f67977a40ed4d638"} err="failed to get container status \"6d8e791c8efbda90f8fba2bf84685c23f32a3d14c9027a36f67977a40ed4d638\": rpc error: code = NotFound desc = could not find container \"6d8e791c8efbda90f8fba2bf84685c23f32a3d14c9027a36f67977a40ed4d638\": container with ID starting with 6d8e791c8efbda90f8fba2bf84685c23f32a3d14c9027a36f67977a40ed4d638 not found: ID does not exist" Jul 02 16:51:16.679790 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.679769 2573 scope.go:117] "RemoveContainer" containerID="75d18f637eeb2398bbc762359245f9745f75c3cdf35b5328877fa6fefa7a4dc6" Jul 02 16:51:16.687088 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.687069 2573 scope.go:117] "RemoveContainer" containerID="75d18f637eeb2398bbc762359245f9745f75c3cdf35b5328877fa6fefa7a4dc6" Jul 02 16:51:16.687450 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:51:16.687418 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75d18f637eeb2398bbc762359245f9745f75c3cdf35b5328877fa6fefa7a4dc6\": container with ID starting with 75d18f637eeb2398bbc762359245f9745f75c3cdf35b5328877fa6fefa7a4dc6 not found: ID does not exist" containerID="75d18f637eeb2398bbc762359245f9745f75c3cdf35b5328877fa6fefa7a4dc6" Jul 02 16:51:16.687587 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.687460 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75d18f637eeb2398bbc762359245f9745f75c3cdf35b5328877fa6fefa7a4dc6"} err="failed to get container status \"75d18f637eeb2398bbc762359245f9745f75c3cdf35b5328877fa6fefa7a4dc6\": rpc error: code = NotFound desc = could not find container \"75d18f637eeb2398bbc762359245f9745f75c3cdf35b5328877fa6fefa7a4dc6\": container with ID starting with 75d18f637eeb2398bbc762359245f9745f75c3cdf35b5328877fa6fefa7a4dc6 not found: ID does not exist" Jul 02 16:51:16.688400 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.688362 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c55b6d4fd-vdfzv" podStartSLOduration=2.261232566 podStartE2EDuration="2.688348565s" totalImagesPullingTime="427.115999ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:51:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:51:16.687306305 +0000 UTC m=+796.604281832" watchObservedRunningTime="2026-07-02 16:51:16.688348565 +0000 UTC m=+796.605324093" Jul 02 16:51:16.702833 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.702795 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6mfbg"] Jul 02 16:51:16.704592 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.704566 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6mfbg"] Jul 02 16:51:16.712545 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.712517 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pdphh"] Jul 02 16:51:16.712757 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.712731 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-pdphh" podUID="bac72432-2069-4b0f-807d-310274837279" containerName="authorino" containerID="cri-o://8aa132598b91833179cd6fdc2f35c13f308bb14806a4c20a02609e3b1440c5af" gracePeriod=30 Jul 02 16:51:16.719564 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.719538 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c8c6f7d58-cdwhl"] Jul 02 16:51:16.722599 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.722576 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c8c6f7d58-cdwhl"] Jul 02 16:51:16.966431 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:16.966406 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pdphh" Jul 02 16:51:17.049519 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:17.049452 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2px58\" (UniqueName: \"kubernetes.io/projected/bac72432-2069-4b0f-807d-310274837279-kube-api-access-2px58\") pod \"bac72432-2069-4b0f-807d-310274837279\" (UID: \"bac72432-2069-4b0f-807d-310274837279\") " Jul 02 16:51:17.051501 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:17.051463 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bac72432-2069-4b0f-807d-310274837279-kube-api-access-2px58" (OuterVolumeSpecName: "kube-api-access-2px58") pod "bac72432-2069-4b0f-807d-310274837279" (UID: "bac72432-2069-4b0f-807d-310274837279"). InnerVolumeSpecName "kube-api-access-2px58". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:51:17.150768 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:17.150681 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2px58\" (UniqueName: \"kubernetes.io/projected/bac72432-2069-4b0f-807d-310274837279-kube-api-access-2px58\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:51:17.681013 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:17.680977 2573 generic.go:356] "Generic (PLEG): container finished" podID="bac72432-2069-4b0f-807d-310274837279" containerID="8aa132598b91833179cd6fdc2f35c13f308bb14806a4c20a02609e3b1440c5af" exitCode=0 Jul 02 16:51:17.681013 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:17.681015 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pdphh" Jul 02 16:51:17.681551 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:17.681049 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pdphh" event={"ID":"bac72432-2069-4b0f-807d-310274837279","Type":"ContainerDied","Data":"8aa132598b91833179cd6fdc2f35c13f308bb14806a4c20a02609e3b1440c5af"} Jul 02 16:51:17.681551 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:17.681085 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pdphh" event={"ID":"bac72432-2069-4b0f-807d-310274837279","Type":"ContainerDied","Data":"c11b8cbe7e2dae93abc1f3674441bdc6e65a51e892d2eb8741b2bb9f3e0313ff"} Jul 02 16:51:17.681551 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:17.681107 2573 scope.go:117] "RemoveContainer" containerID="8aa132598b91833179cd6fdc2f35c13f308bb14806a4c20a02609e3b1440c5af" Jul 02 16:51:17.689528 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:17.689504 2573 scope.go:117] "RemoveContainer" containerID="8aa132598b91833179cd6fdc2f35c13f308bb14806a4c20a02609e3b1440c5af" Jul 02 16:51:17.689779 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:51:17.689762 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aa132598b91833179cd6fdc2f35c13f308bb14806a4c20a02609e3b1440c5af\": container with ID starting with 8aa132598b91833179cd6fdc2f35c13f308bb14806a4c20a02609e3b1440c5af not found: ID does not exist" containerID="8aa132598b91833179cd6fdc2f35c13f308bb14806a4c20a02609e3b1440c5af" Jul 02 16:51:17.689825 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:17.689788 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aa132598b91833179cd6fdc2f35c13f308bb14806a4c20a02609e3b1440c5af"} err="failed to get container status \"8aa132598b91833179cd6fdc2f35c13f308bb14806a4c20a02609e3b1440c5af\": rpc error: code = NotFound desc = could not find container \"8aa132598b91833179cd6fdc2f35c13f308bb14806a4c20a02609e3b1440c5af\": container with ID starting with 8aa132598b91833179cd6fdc2f35c13f308bb14806a4c20a02609e3b1440c5af not found: ID does not exist" Jul 02 16:51:17.700949 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:17.700921 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pdphh"] Jul 02 16:51:17.705085 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:17.705060 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pdphh"] Jul 02 16:51:18.554428 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:18.554398 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3dde770-5146-461d-8f40-d71b965ecfa5" path="/var/lib/kubelet/pods/b3dde770-5146-461d-8f40-d71b965ecfa5/volumes" Jul 02 16:51:18.554744 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:18.554729 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bac72432-2069-4b0f-807d-310274837279" path="/var/lib/kubelet/pods/bac72432-2069-4b0f-807d-310274837279/volumes" Jul 02 16:51:18.555000 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:18.554987 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8" path="/var/lib/kubelet/pods/e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8/volumes" Jul 02 16:51:58.121392 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:51:58.121354 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crg28"] Jul 02 16:52:46.830348 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:46.830311 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f9c8d895b-2zphb"] Jul 02 16:52:46.830854 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:46.830602 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8" containerName="authorino" Jul 02 16:52:46.830854 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:46.830613 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8" containerName="authorino" Jul 02 16:52:46.830854 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:46.830621 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bac72432-2069-4b0f-807d-310274837279" containerName="authorino" Jul 02 16:52:46.830854 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:46.830627 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bac72432-2069-4b0f-807d-310274837279" containerName="authorino" Jul 02 16:52:46.830854 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:46.830633 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3dde770-5146-461d-8f40-d71b965ecfa5" containerName="authorino" Jul 02 16:52:46.830854 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:46.830639 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3dde770-5146-461d-8f40-d71b965ecfa5" containerName="authorino" Jul 02 16:52:46.830854 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:46.830691 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bac72432-2069-4b0f-807d-310274837279" containerName="authorino" Jul 02 16:52:46.830854 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:46.830699 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4f6b9f3-cce8-42e1-b835-f18d13d0f2b8" containerName="authorino" Jul 02 16:52:46.830854 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:46.830705 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3dde770-5146-461d-8f40-d71b965ecfa5" containerName="authorino" Jul 02 16:52:46.833523 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:46.833507 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f9c8d895b-2zphb" Jul 02 16:52:46.840779 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:46.840751 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jul 02 16:52:46.845947 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:46.845917 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f9c8d895b-2zphb"] Jul 02 16:52:46.978355 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:46.978323 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsnkw\" (UniqueName: \"kubernetes.io/projected/6490dd7f-879a-45be-aa8f-301c33407290-kube-api-access-tsnkw\") pod \"authorino-7f9c8d895b-2zphb\" (UID: \"6490dd7f-879a-45be-aa8f-301c33407290\") " pod="kuadrant-system/authorino-7f9c8d895b-2zphb" Jul 02 16:52:46.978564 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:46.978361 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6490dd7f-879a-45be-aa8f-301c33407290-oidc-ca\") pod \"authorino-7f9c8d895b-2zphb\" (UID: \"6490dd7f-879a-45be-aa8f-301c33407290\") " pod="kuadrant-system/authorino-7f9c8d895b-2zphb" Jul 02 16:52:46.978564 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:46.978393 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6490dd7f-879a-45be-aa8f-301c33407290-tls-cert\") pod \"authorino-7f9c8d895b-2zphb\" (UID: \"6490dd7f-879a-45be-aa8f-301c33407290\") " pod="kuadrant-system/authorino-7f9c8d895b-2zphb" Jul 02 16:52:47.079356 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:47.079313 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6490dd7f-879a-45be-aa8f-301c33407290-oidc-ca\") pod \"authorino-7f9c8d895b-2zphb\" (UID: \"6490dd7f-879a-45be-aa8f-301c33407290\") " pod="kuadrant-system/authorino-7f9c8d895b-2zphb" Jul 02 16:52:47.079563 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:47.079366 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6490dd7f-879a-45be-aa8f-301c33407290-tls-cert\") pod \"authorino-7f9c8d895b-2zphb\" (UID: \"6490dd7f-879a-45be-aa8f-301c33407290\") " pod="kuadrant-system/authorino-7f9c8d895b-2zphb" Jul 02 16:52:47.079563 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:47.079414 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsnkw\" (UniqueName: \"kubernetes.io/projected/6490dd7f-879a-45be-aa8f-301c33407290-kube-api-access-tsnkw\") pod \"authorino-7f9c8d895b-2zphb\" (UID: \"6490dd7f-879a-45be-aa8f-301c33407290\") " pod="kuadrant-system/authorino-7f9c8d895b-2zphb" Jul 02 16:52:47.079977 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:47.079954 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6490dd7f-879a-45be-aa8f-301c33407290-oidc-ca\") pod \"authorino-7f9c8d895b-2zphb\" (UID: \"6490dd7f-879a-45be-aa8f-301c33407290\") " pod="kuadrant-system/authorino-7f9c8d895b-2zphb" Jul 02 16:52:47.081871 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:47.081818 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6490dd7f-879a-45be-aa8f-301c33407290-tls-cert\") pod \"authorino-7f9c8d895b-2zphb\" (UID: \"6490dd7f-879a-45be-aa8f-301c33407290\") " pod="kuadrant-system/authorino-7f9c8d895b-2zphb" Jul 02 16:52:47.087378 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:47.087351 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsnkw\" (UniqueName: \"kubernetes.io/projected/6490dd7f-879a-45be-aa8f-301c33407290-kube-api-access-tsnkw\") pod \"authorino-7f9c8d895b-2zphb\" (UID: \"6490dd7f-879a-45be-aa8f-301c33407290\") " pod="kuadrant-system/authorino-7f9c8d895b-2zphb" Jul 02 16:52:47.160785 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:47.160747 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f9c8d895b-2zphb" Jul 02 16:52:47.291502 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:47.291454 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f9c8d895b-2zphb"] Jul 02 16:52:47.294314 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:52:47.294285 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6490dd7f_879a_45be_aa8f_301c33407290.slice/crio-ff7ba48799f96ebb977459b8e33742c506e6cb318a9dd48322a5026fe098a335 WatchSource:0}: Error finding container ff7ba48799f96ebb977459b8e33742c506e6cb318a9dd48322a5026fe098a335: Status 404 returned error can't find the container with id ff7ba48799f96ebb977459b8e33742c506e6cb318a9dd48322a5026fe098a335 Jul 02 16:52:48.060205 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:48.060103 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f9c8d895b-2zphb" event={"ID":"6490dd7f-879a-45be-aa8f-301c33407290","Type":"ContainerStarted","Data":"0b4130e8fcf499a2e24c23fe3e6ac124342a86f5e07cef65fa772f247ea6fb5d"} Jul 02 16:52:48.060205 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:48.060147 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f9c8d895b-2zphb" event={"ID":"6490dd7f-879a-45be-aa8f-301c33407290","Type":"ContainerStarted","Data":"ff7ba48799f96ebb977459b8e33742c506e6cb318a9dd48322a5026fe098a335"} Jul 02 16:52:48.074843 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:48.074791 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f9c8d895b-2zphb" podStartSLOduration=1.672374692 podStartE2EDuration="2.074772401s" totalImagesPullingTime="402.397709ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:52:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:52:48.073936173 +0000 UTC m=+887.990911699" watchObservedRunningTime="2026-07-02 16:52:48.074772401 +0000 UTC m=+887.991747929" Jul 02 16:52:48.100248 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:48.100217 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c55b6d4fd-vdfzv"] Jul 02 16:52:48.100445 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:48.100418 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5c55b6d4fd-vdfzv" podUID="4edc4f2b-f162-43e9-afe6-6f19e6502fa2" containerName="authorino" containerID="cri-o://0623bbbb7b48c628927bc3061133b43f75a5a1ac6a6e4e69fbda80a876b2a01b" gracePeriod=30 Jul 02 16:52:48.344570 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:48.344543 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c55b6d4fd-vdfzv" Jul 02 16:52:48.491235 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:48.491194 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jljrr\" (UniqueName: \"kubernetes.io/projected/4edc4f2b-f162-43e9-afe6-6f19e6502fa2-kube-api-access-jljrr\") pod \"4edc4f2b-f162-43e9-afe6-6f19e6502fa2\" (UID: \"4edc4f2b-f162-43e9-afe6-6f19e6502fa2\") " Jul 02 16:52:48.491411 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:48.491252 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4edc4f2b-f162-43e9-afe6-6f19e6502fa2-tls-cert\") pod \"4edc4f2b-f162-43e9-afe6-6f19e6502fa2\" (UID: \"4edc4f2b-f162-43e9-afe6-6f19e6502fa2\") " Jul 02 16:52:48.493446 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:48.493413 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4edc4f2b-f162-43e9-afe6-6f19e6502fa2-kube-api-access-jljrr" (OuterVolumeSpecName: "kube-api-access-jljrr") pod "4edc4f2b-f162-43e9-afe6-6f19e6502fa2" (UID: "4edc4f2b-f162-43e9-afe6-6f19e6502fa2"). InnerVolumeSpecName "kube-api-access-jljrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:52:48.500886 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:48.500854 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4edc4f2b-f162-43e9-afe6-6f19e6502fa2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4edc4f2b-f162-43e9-afe6-6f19e6502fa2" (UID: "4edc4f2b-f162-43e9-afe6-6f19e6502fa2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:52:48.591933 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:48.591904 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jljrr\" (UniqueName: \"kubernetes.io/projected/4edc4f2b-f162-43e9-afe6-6f19e6502fa2-kube-api-access-jljrr\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:52:48.591933 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:48.591933 2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4edc4f2b-f162-43e9-afe6-6f19e6502fa2-tls-cert\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:52:49.066260 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:49.066226 2573 generic.go:356] "Generic (PLEG): container finished" podID="4edc4f2b-f162-43e9-afe6-6f19e6502fa2" containerID="0623bbbb7b48c628927bc3061133b43f75a5a1ac6a6e4e69fbda80a876b2a01b" exitCode=0 Jul 02 16:52:49.066755 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:49.066266 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c55b6d4fd-vdfzv" Jul 02 16:52:49.066755 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:49.066300 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c55b6d4fd-vdfzv" event={"ID":"4edc4f2b-f162-43e9-afe6-6f19e6502fa2","Type":"ContainerDied","Data":"0623bbbb7b48c628927bc3061133b43f75a5a1ac6a6e4e69fbda80a876b2a01b"} Jul 02 16:52:49.066755 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:49.066330 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c55b6d4fd-vdfzv" event={"ID":"4edc4f2b-f162-43e9-afe6-6f19e6502fa2","Type":"ContainerDied","Data":"6a70f254754206e6d69088e0a1dde9ad037260aeb554170693d85731f02bad9b"} Jul 02 16:52:49.066755 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:49.066346 2573 scope.go:117] "RemoveContainer" containerID="0623bbbb7b48c628927bc3061133b43f75a5a1ac6a6e4e69fbda80a876b2a01b" Jul 02 16:52:49.074440 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:49.074421 2573 scope.go:117] "RemoveContainer" containerID="0623bbbb7b48c628927bc3061133b43f75a5a1ac6a6e4e69fbda80a876b2a01b" Jul 02 16:52:49.074722 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:52:49.074704 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0623bbbb7b48c628927bc3061133b43f75a5a1ac6a6e4e69fbda80a876b2a01b\": container with ID starting with 0623bbbb7b48c628927bc3061133b43f75a5a1ac6a6e4e69fbda80a876b2a01b not found: ID does not exist" containerID="0623bbbb7b48c628927bc3061133b43f75a5a1ac6a6e4e69fbda80a876b2a01b" Jul 02 16:52:49.074780 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:49.074731 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0623bbbb7b48c628927bc3061133b43f75a5a1ac6a6e4e69fbda80a876b2a01b"} err="failed to get container status \"0623bbbb7b48c628927bc3061133b43f75a5a1ac6a6e4e69fbda80a876b2a01b\": rpc error: code = NotFound desc = could not find container \"0623bbbb7b48c628927bc3061133b43f75a5a1ac6a6e4e69fbda80a876b2a01b\": container with ID starting with 0623bbbb7b48c628927bc3061133b43f75a5a1ac6a6e4e69fbda80a876b2a01b not found: ID does not exist" Jul 02 16:52:49.081354 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:49.081330 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c55b6d4fd-vdfzv"] Jul 02 16:52:49.085359 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:49.085327 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c55b6d4fd-vdfzv"] Jul 02 16:52:50.555947 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:50.555909 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4edc4f2b-f162-43e9-afe6-6f19e6502fa2" path="/var/lib/kubelet/pods/4edc4f2b-f162-43e9-afe6-6f19e6502fa2/volumes" Jul 02 16:52:59.239773 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:52:59.239685 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crg28"] Jul 02 16:53:00.544411 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:00.544372 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w9jrc_56c62a91-75b9-497f-8114-278f6da1fcce/ovn-acl-logging/0.log" Jul 02 16:53:00.546344 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:00.546317 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w9jrc_56c62a91-75b9-497f-8114-278f6da1fcce/ovn-acl-logging/0.log" Jul 02 16:53:24.326768 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.326724 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v"] Jul 02 16:53:24.327447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.327162 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4edc4f2b-f162-43e9-afe6-6f19e6502fa2" containerName="authorino" Jul 02 16:53:24.327447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.327185 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4edc4f2b-f162-43e9-afe6-6f19e6502fa2" containerName="authorino" Jul 02 16:53:24.327447 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.327285 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4edc4f2b-f162-43e9-afe6-6f19e6502fa2" containerName="authorino" Jul 02 16:53:24.331922 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.331895 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.334575 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.334548 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 16:53:24.335449 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.335429 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sq5dl\"" Jul 02 16:53:24.335579 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.335486 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 02 16:53:24.335579 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.335488 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 16:53:24.339031 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.339004 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v"] Jul 02 16:53:24.442296 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.442251 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b25d132-f381-4d11-b621-eb2a177a0e7c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7g9v\" (UID: \"1b25d132-f381-4d11-b621-eb2a177a0e7c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.442296 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.442294 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4vmv\" (UniqueName: \"kubernetes.io/projected/1b25d132-f381-4d11-b621-eb2a177a0e7c-kube-api-access-r4vmv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7g9v\" (UID: \"1b25d132-f381-4d11-b621-eb2a177a0e7c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.442552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.442388 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b25d132-f381-4d11-b621-eb2a177a0e7c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7g9v\" (UID: \"1b25d132-f381-4d11-b621-eb2a177a0e7c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.442552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.442457 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b25d132-f381-4d11-b621-eb2a177a0e7c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7g9v\" (UID: \"1b25d132-f381-4d11-b621-eb2a177a0e7c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.442552 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.442529 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b25d132-f381-4d11-b621-eb2a177a0e7c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7g9v\" (UID: \"1b25d132-f381-4d11-b621-eb2a177a0e7c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.442675 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.442570 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b25d132-f381-4d11-b621-eb2a177a0e7c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7g9v\" (UID: \"1b25d132-f381-4d11-b621-eb2a177a0e7c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.543934 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.543898 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b25d132-f381-4d11-b621-eb2a177a0e7c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7g9v\" (UID: \"1b25d132-f381-4d11-b621-eb2a177a0e7c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.544113 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.543955 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b25d132-f381-4d11-b621-eb2a177a0e7c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7g9v\" (UID: \"1b25d132-f381-4d11-b621-eb2a177a0e7c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.544113 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.543983 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b25d132-f381-4d11-b621-eb2a177a0e7c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7g9v\" (UID: \"1b25d132-f381-4d11-b621-eb2a177a0e7c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.544113 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.544006 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b25d132-f381-4d11-b621-eb2a177a0e7c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7g9v\" (UID: \"1b25d132-f381-4d11-b621-eb2a177a0e7c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.544113 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.544027 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b25d132-f381-4d11-b621-eb2a177a0e7c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7g9v\" (UID: \"1b25d132-f381-4d11-b621-eb2a177a0e7c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.544113 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.544054 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4vmv\" (UniqueName: \"kubernetes.io/projected/1b25d132-f381-4d11-b621-eb2a177a0e7c-kube-api-access-r4vmv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7g9v\" (UID: \"1b25d132-f381-4d11-b621-eb2a177a0e7c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.544360 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.544301 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b25d132-f381-4d11-b621-eb2a177a0e7c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7g9v\" (UID: \"1b25d132-f381-4d11-b621-eb2a177a0e7c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.544420 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.544367 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b25d132-f381-4d11-b621-eb2a177a0e7c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7g9v\" (UID: \"1b25d132-f381-4d11-b621-eb2a177a0e7c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.544531 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.544504 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b25d132-f381-4d11-b621-eb2a177a0e7c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7g9v\" (UID: \"1b25d132-f381-4d11-b621-eb2a177a0e7c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.546255 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.546237 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b25d132-f381-4d11-b621-eb2a177a0e7c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7g9v\" (UID: \"1b25d132-f381-4d11-b621-eb2a177a0e7c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.546603 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.546584 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b25d132-f381-4d11-b621-eb2a177a0e7c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7g9v\" (UID: \"1b25d132-f381-4d11-b621-eb2a177a0e7c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.554389 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.554353 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4vmv\" (UniqueName: \"kubernetes.io/projected/1b25d132-f381-4d11-b621-eb2a177a0e7c-kube-api-access-r4vmv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x7g9v\" (UID: \"1b25d132-f381-4d11-b621-eb2a177a0e7c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.643907 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.643859 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:24.775927 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:24.775897 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v"] Jul 02 16:53:24.778626 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:53:24.778597 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b25d132_f381_4d11_b621_eb2a177a0e7c.slice/crio-78caddea858eda1726fd54eab1949530656c47b49c27c2132450bef03cf9f72a WatchSource:0}: Error finding container 78caddea858eda1726fd54eab1949530656c47b49c27c2132450bef03cf9f72a: Status 404 returned error can't find the container with id 78caddea858eda1726fd54eab1949530656c47b49c27c2132450bef03cf9f72a Jul 02 16:53:25.140186 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:25.139712 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crg28"] Jul 02 16:53:25.227973 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:25.227933 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" event={"ID":"1b25d132-f381-4d11-b621-eb2a177a0e7c","Type":"ContainerStarted","Data":"78caddea858eda1726fd54eab1949530656c47b49c27c2132450bef03cf9f72a"} Jul 02 16:53:26.233637 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:26.233545 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" event={"ID":"1b25d132-f381-4d11-b621-eb2a177a0e7c","Type":"ContainerStarted","Data":"4f35a44208d59f52f09a4e4c4fdaf80f57d166a39407c0baf558fd1c2aca4551"} Jul 02 16:53:26.251289 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:26.251209 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" podStartSLOduration=1.154025567 podStartE2EDuration="2.251189926s" totalImagesPullingTime="1.097164359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:53:26.248816492 +0000 UTC m=+926.165792020" watchObservedRunningTime="2026-07-02 16:53:26.251189926 +0000 UTC m=+926.168165453" Jul 02 16:53:34.644749 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:34.644708 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:34.645218 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:34.644787 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:34.657181 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:34.657149 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:35.286678 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:35.286652 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x7g9v" Jul 02 16:53:50.744675 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:50.744637 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crg28"] Jul 02 16:53:54.842064 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:53:54.842023 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crg28"] Jul 02 16:54:12.344516 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:12.344463 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crg28"] Jul 02 16:54:29.310241 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.310159 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg"] Jul 02 16:54:29.312288 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.312268 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.314523 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.314498 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 02 16:54:29.324177 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.324156 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg"] Jul 02 16:54:29.380249 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.380213 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvprq\" (UniqueName: \"kubernetes.io/projected/62cf20c1-a717-438d-8ce6-610ec72a20c7-kube-api-access-nvprq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg\" (UID: \"62cf20c1-a717-438d-8ce6-610ec72a20c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.380446 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.380271 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62cf20c1-a717-438d-8ce6-610ec72a20c7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg\" (UID: \"62cf20c1-a717-438d-8ce6-610ec72a20c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.380446 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.380323 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62cf20c1-a717-438d-8ce6-610ec72a20c7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg\" (UID: \"62cf20c1-a717-438d-8ce6-610ec72a20c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.380446 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.380379 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62cf20c1-a717-438d-8ce6-610ec72a20c7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg\" (UID: \"62cf20c1-a717-438d-8ce6-610ec72a20c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.380446 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.380404 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62cf20c1-a717-438d-8ce6-610ec72a20c7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg\" (UID: \"62cf20c1-a717-438d-8ce6-610ec72a20c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.380446 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.380434 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62cf20c1-a717-438d-8ce6-610ec72a20c7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg\" (UID: \"62cf20c1-a717-438d-8ce6-610ec72a20c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.481315 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.481274 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvprq\" (UniqueName: \"kubernetes.io/projected/62cf20c1-a717-438d-8ce6-610ec72a20c7-kube-api-access-nvprq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg\" (UID: \"62cf20c1-a717-438d-8ce6-610ec72a20c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.481530 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.481334 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62cf20c1-a717-438d-8ce6-610ec72a20c7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg\" (UID: \"62cf20c1-a717-438d-8ce6-610ec72a20c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.481530 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.481356 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62cf20c1-a717-438d-8ce6-610ec72a20c7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg\" (UID: \"62cf20c1-a717-438d-8ce6-610ec72a20c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.481530 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.481377 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62cf20c1-a717-438d-8ce6-610ec72a20c7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg\" (UID: \"62cf20c1-a717-438d-8ce6-610ec72a20c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.481530 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.481393 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62cf20c1-a717-438d-8ce6-610ec72a20c7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg\" (UID: \"62cf20c1-a717-438d-8ce6-610ec72a20c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.481530 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.481413 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62cf20c1-a717-438d-8ce6-610ec72a20c7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg\" (UID: \"62cf20c1-a717-438d-8ce6-610ec72a20c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.481849 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.481748 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62cf20c1-a717-438d-8ce6-610ec72a20c7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg\" (UID: \"62cf20c1-a717-438d-8ce6-610ec72a20c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.481849 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.481811 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62cf20c1-a717-438d-8ce6-610ec72a20c7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg\" (UID: \"62cf20c1-a717-438d-8ce6-610ec72a20c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.481959 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.481878 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62cf20c1-a717-438d-8ce6-610ec72a20c7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg\" (UID: \"62cf20c1-a717-438d-8ce6-610ec72a20c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.483723 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.483700 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62cf20c1-a717-438d-8ce6-610ec72a20c7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg\" (UID: \"62cf20c1-a717-438d-8ce6-610ec72a20c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.483990 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.483970 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62cf20c1-a717-438d-8ce6-610ec72a20c7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg\" (UID: \"62cf20c1-a717-438d-8ce6-610ec72a20c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.487822 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.487799 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvprq\" (UniqueName: \"kubernetes.io/projected/62cf20c1-a717-438d-8ce6-610ec72a20c7-kube-api-access-nvprq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg\" (UID: \"62cf20c1-a717-438d-8ce6-610ec72a20c7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.622803 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.622766 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:29.747881 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:29.747811 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg"] Jul 02 16:54:29.750187 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:54:29.750162 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62cf20c1_a717_438d_8ce6_610ec72a20c7.slice/crio-578455f77846ff81b66efd243f0a23e2bf67038b648334f73193819cf49e6f75 WatchSource:0}: Error finding container 578455f77846ff81b66efd243f0a23e2bf67038b648334f73193819cf49e6f75: Status 404 returned error can't find the container with id 578455f77846ff81b66efd243f0a23e2bf67038b648334f73193819cf49e6f75 Jul 02 16:54:30.516400 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:30.516361 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" event={"ID":"62cf20c1-a717-438d-8ce6-610ec72a20c7","Type":"ContainerStarted","Data":"d4a1482d89daa93a86dee4f4a47330b78cee4d7142f84cd0bc2c86fd4078bce0"} Jul 02 16:54:30.516823 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:30.516416 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" event={"ID":"62cf20c1-a717-438d-8ce6-610ec72a20c7","Type":"ContainerStarted","Data":"578455f77846ff81b66efd243f0a23e2bf67038b648334f73193819cf49e6f75"} Jul 02 16:54:30.534752 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:30.534699 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" podStartSLOduration=1.370579779 podStartE2EDuration="1.53468039s" totalImagesPullingTime="164.100611ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:54:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:54:30.533001018 +0000 UTC m=+990.449976545" watchObservedRunningTime="2026-07-02 16:54:30.53468039 +0000 UTC m=+990.451655918" Jul 02 16:54:31.847588 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:31.847558 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-crg28"] Jul 02 16:54:39.623081 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:39.623037 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:39.623513 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:39.623096 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:39.635655 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:39.635629 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:54:40.571354 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:54:40.571326 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg" Jul 02 16:55:41.205008 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:41.204966 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59748cd97-k9f52"] Jul 02 16:55:41.207344 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:41.207319 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59748cd97-k9f52" Jul 02 16:55:41.216522 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:41.216493 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59748cd97-k9f52"] Jul 02 16:55:41.294156 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:41.294119 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/416e9156-47dd-4239-8244-1fc5cc5d847a-oidc-ca\") pod \"authorino-59748cd97-k9f52\" (UID: \"416e9156-47dd-4239-8244-1fc5cc5d847a\") " pod="kuadrant-system/authorino-59748cd97-k9f52" Jul 02 16:55:41.294156 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:41.294168 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kxf5\" (UniqueName: \"kubernetes.io/projected/416e9156-47dd-4239-8244-1fc5cc5d847a-kube-api-access-5kxf5\") pod \"authorino-59748cd97-k9f52\" (UID: \"416e9156-47dd-4239-8244-1fc5cc5d847a\") " pod="kuadrant-system/authorino-59748cd97-k9f52" Jul 02 16:55:41.294367 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:41.294241 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/416e9156-47dd-4239-8244-1fc5cc5d847a-tls-cert\") pod \"authorino-59748cd97-k9f52\" (UID: \"416e9156-47dd-4239-8244-1fc5cc5d847a\") " pod="kuadrant-system/authorino-59748cd97-k9f52" Jul 02 16:55:41.395533 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:41.395493 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/416e9156-47dd-4239-8244-1fc5cc5d847a-tls-cert\") pod \"authorino-59748cd97-k9f52\" (UID: \"416e9156-47dd-4239-8244-1fc5cc5d847a\") " pod="kuadrant-system/authorino-59748cd97-k9f52" Jul 02 16:55:41.395710 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:41.395558 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/416e9156-47dd-4239-8244-1fc5cc5d847a-oidc-ca\") pod \"authorino-59748cd97-k9f52\" (UID: \"416e9156-47dd-4239-8244-1fc5cc5d847a\") " pod="kuadrant-system/authorino-59748cd97-k9f52" Jul 02 16:55:41.395710 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:41.395588 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kxf5\" (UniqueName: \"kubernetes.io/projected/416e9156-47dd-4239-8244-1fc5cc5d847a-kube-api-access-5kxf5\") pod \"authorino-59748cd97-k9f52\" (UID: \"416e9156-47dd-4239-8244-1fc5cc5d847a\") " pod="kuadrant-system/authorino-59748cd97-k9f52" Jul 02 16:55:41.396330 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:41.396300 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/416e9156-47dd-4239-8244-1fc5cc5d847a-oidc-ca\") pod \"authorino-59748cd97-k9f52\" (UID: \"416e9156-47dd-4239-8244-1fc5cc5d847a\") " pod="kuadrant-system/authorino-59748cd97-k9f52" Jul 02 16:55:41.397988 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:41.397958 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/416e9156-47dd-4239-8244-1fc5cc5d847a-tls-cert\") pod \"authorino-59748cd97-k9f52\" (UID: \"416e9156-47dd-4239-8244-1fc5cc5d847a\") " pod="kuadrant-system/authorino-59748cd97-k9f52" Jul 02 16:55:41.403617 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:41.403586 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kxf5\" (UniqueName: \"kubernetes.io/projected/416e9156-47dd-4239-8244-1fc5cc5d847a-kube-api-access-5kxf5\") pod \"authorino-59748cd97-k9f52\" (UID: \"416e9156-47dd-4239-8244-1fc5cc5d847a\") " pod="kuadrant-system/authorino-59748cd97-k9f52" Jul 02 16:55:41.517666 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:41.517572 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59748cd97-k9f52" Jul 02 16:55:41.646648 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:41.646613 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59748cd97-k9f52"] Jul 02 16:55:41.649162 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:55:41.649137 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod416e9156_47dd_4239_8244_1fc5cc5d847a.slice/crio-64f3b2816c641c37b905505bfc1083e2567ecf2a3781dc7aa8c17344dbe3e5ea WatchSource:0}: Error finding container 64f3b2816c641c37b905505bfc1083e2567ecf2a3781dc7aa8c17344dbe3e5ea: Status 404 returned error can't find the container with id 64f3b2816c641c37b905505bfc1083e2567ecf2a3781dc7aa8c17344dbe3e5ea Jul 02 16:55:41.821709 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:41.821621 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59748cd97-k9f52" event={"ID":"416e9156-47dd-4239-8244-1fc5cc5d847a","Type":"ContainerStarted","Data":"64f3b2816c641c37b905505bfc1083e2567ecf2a3781dc7aa8c17344dbe3e5ea"} Jul 02 16:55:42.111287 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:55:42.111236 2573 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/kuadrant/authorino:v0.24.0" Jul 02 16:55:42.111455 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:55:42.111349 2573 kuberuntime_manager.go:1459] "Unhandled Error" err="container authorino start failed in pod authorino-59748cd97-k9f52_kuadrant-system(416e9156-47dd-4239-8244-1fc5cc5d847a): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 02 16:55:42.111455 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:55:42.111384 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"authorino\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kuadrant-system/authorino-59748cd97-k9f52" podUID="416e9156-47dd-4239-8244-1fc5cc5d847a" Jul 02 16:55:42.825970 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:55:42.825927 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"authorino\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/kuadrant/authorino:v0.24.0\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kuadrant-system/authorino-59748cd97-k9f52" podUID="416e9156-47dd-4239-8244-1fc5cc5d847a" Jul 02 16:55:54.880029 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:54.879987 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59748cd97-k9f52" event={"ID":"416e9156-47dd-4239-8244-1fc5cc5d847a","Type":"ContainerStarted","Data":"69f6b956900a83bd680ea6e0ff682db1313d7fd1c2486611498cef34ab841695"} Jul 02 16:55:54.896509 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:54.896444 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59748cd97-k9f52" podStartSLOduration=1.703533491 podStartE2EDuration="13.896426781s" totalImagesPullingTime="12.19289329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:55:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-02 16:55:54.895516311 +0000 UTC m=+1074.812491841" watchObservedRunningTime="2026-07-02 16:55:54.896426781 +0000 UTC m=+1074.813402324" Jul 02 16:55:54.926174 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:54.926142 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f9c8d895b-2zphb"] Jul 02 16:55:54.926372 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:54.926345 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7f9c8d895b-2zphb" podUID="6490dd7f-879a-45be-aa8f-301c33407290" containerName="authorino" containerID="cri-o://0b4130e8fcf499a2e24c23fe3e6ac124342a86f5e07cef65fa772f247ea6fb5d" gracePeriod=30 Jul 02 16:55:55.187146 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.187120 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f9c8d895b-2zphb" Jul 02 16:55:55.314389 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.314351 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6490dd7f-879a-45be-aa8f-301c33407290-tls-cert\") pod \"6490dd7f-879a-45be-aa8f-301c33407290\" (UID: \"6490dd7f-879a-45be-aa8f-301c33407290\") " Jul 02 16:55:55.314566 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.314421 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6490dd7f-879a-45be-aa8f-301c33407290-oidc-ca\") pod \"6490dd7f-879a-45be-aa8f-301c33407290\" (UID: \"6490dd7f-879a-45be-aa8f-301c33407290\") " Jul 02 16:55:55.314566 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.314527 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsnkw\" (UniqueName: \"kubernetes.io/projected/6490dd7f-879a-45be-aa8f-301c33407290-kube-api-access-tsnkw\") pod \"6490dd7f-879a-45be-aa8f-301c33407290\" (UID: \"6490dd7f-879a-45be-aa8f-301c33407290\") " Jul 02 16:55:55.316647 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.316606 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6490dd7f-879a-45be-aa8f-301c33407290-kube-api-access-tsnkw" (OuterVolumeSpecName: "kube-api-access-tsnkw") pod "6490dd7f-879a-45be-aa8f-301c33407290" (UID: "6490dd7f-879a-45be-aa8f-301c33407290"). InnerVolumeSpecName "kube-api-access-tsnkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 16:55:55.318967 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.318935 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6490dd7f-879a-45be-aa8f-301c33407290-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "6490dd7f-879a-45be-aa8f-301c33407290" (UID: "6490dd7f-879a-45be-aa8f-301c33407290"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 16:55:55.323897 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.323870 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6490dd7f-879a-45be-aa8f-301c33407290-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6490dd7f-879a-45be-aa8f-301c33407290" (UID: "6490dd7f-879a-45be-aa8f-301c33407290"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 16:55:55.416059 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.415959 2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6490dd7f-879a-45be-aa8f-301c33407290-tls-cert\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:55:55.416059 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.416005 2573 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6490dd7f-879a-45be-aa8f-301c33407290-oidc-ca\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:55:55.416059 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.416022 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsnkw\" (UniqueName: \"kubernetes.io/projected/6490dd7f-879a-45be-aa8f-301c33407290-kube-api-access-tsnkw\") on node \"ip-10-0-134-249.ec2.internal\" DevicePath \"\"" Jul 02 16:55:55.886396 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.886365 2573 generic.go:356] "Generic (PLEG): container finished" podID="6490dd7f-879a-45be-aa8f-301c33407290" containerID="0b4130e8fcf499a2e24c23fe3e6ac124342a86f5e07cef65fa772f247ea6fb5d" exitCode=0 Jul 02 16:55:55.886852 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.886427 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f9c8d895b-2zphb" Jul 02 16:55:55.886852 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.886446 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f9c8d895b-2zphb" event={"ID":"6490dd7f-879a-45be-aa8f-301c33407290","Type":"ContainerDied","Data":"0b4130e8fcf499a2e24c23fe3e6ac124342a86f5e07cef65fa772f247ea6fb5d"} Jul 02 16:55:55.886852 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.886498 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f9c8d895b-2zphb" event={"ID":"6490dd7f-879a-45be-aa8f-301c33407290","Type":"ContainerDied","Data":"ff7ba48799f96ebb977459b8e33742c506e6cb318a9dd48322a5026fe098a335"} Jul 02 16:55:55.886852 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.886521 2573 scope.go:117] "RemoveContainer" containerID="0b4130e8fcf499a2e24c23fe3e6ac124342a86f5e07cef65fa772f247ea6fb5d" Jul 02 16:55:55.895283 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.895262 2573 scope.go:117] "RemoveContainer" containerID="0b4130e8fcf499a2e24c23fe3e6ac124342a86f5e07cef65fa772f247ea6fb5d" Jul 02 16:55:55.895598 ip-10-0-134-249 kubenswrapper[2573]: E0702 16:55:55.895581 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b4130e8fcf499a2e24c23fe3e6ac124342a86f5e07cef65fa772f247ea6fb5d\": container with ID starting with 0b4130e8fcf499a2e24c23fe3e6ac124342a86f5e07cef65fa772f247ea6fb5d not found: ID does not exist" containerID="0b4130e8fcf499a2e24c23fe3e6ac124342a86f5e07cef65fa772f247ea6fb5d" Jul 02 16:55:55.895682 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.895605 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b4130e8fcf499a2e24c23fe3e6ac124342a86f5e07cef65fa772f247ea6fb5d"} err="failed to get container status \"0b4130e8fcf499a2e24c23fe3e6ac124342a86f5e07cef65fa772f247ea6fb5d\": rpc error: code = NotFound desc = could not find container \"0b4130e8fcf499a2e24c23fe3e6ac124342a86f5e07cef65fa772f247ea6fb5d\": container with ID starting with 0b4130e8fcf499a2e24c23fe3e6ac124342a86f5e07cef65fa772f247ea6fb5d not found: ID does not exist" Jul 02 16:55:55.910263 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.910231 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f9c8d895b-2zphb"] Jul 02 16:55:55.913522 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:55.913497 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7f9c8d895b-2zphb"] Jul 02 16:55:56.554855 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:55:56.554820 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6490dd7f-879a-45be-aa8f-301c33407290" path="/var/lib/kubelet/pods/6490dd7f-879a-45be-aa8f-301c33407290/volumes" Jul 02 16:56:40.190634 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:40.190591 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59748cd97-k9f52_416e9156-47dd-4239-8244-1fc5cc5d847a/authorino/0.log" Jul 02 16:56:46.925587 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:46.925549 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fw2cg_05a12bb3-6654-4bb4-9a00-17404c02dc1b/manager/0.log" Jul 02 16:56:47.413122 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:47.413095 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6486c9fccb-q7v4m_95687aed-a1f3-4dea-a633-3c6abdff6d35/manager/0.log" Jul 02 16:56:47.420618 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:47.420594 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6486c9fccb-q7v4m_95687aed-a1f3-4dea-a633-3c6abdff6d35/copy-manifests/0.log" Jul 02 16:56:49.098316 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:49.098285 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59748cd97-k9f52_416e9156-47dd-4239-8244-1fc5cc5d847a/authorino/0.log" Jul 02 16:56:49.502098 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:49.502017 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-26hmn_6485255b-11a5-46be-b71c-f68fdf7d0449/kuadrant-console-plugin/0.log" Jul 02 16:56:49.956812 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:49.956784 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-crg28_8db180be-0e9b-4497-a46c-c4b8aaad2a04/limitador/0.log" Jul 02 16:56:50.745354 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:50.745320 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cc966699b-qns56_8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78/kube-auth-proxy/0.log" Jul 02 16:56:51.902592 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:51.902559 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-x7g9v_1b25d132-f381-4d11-b621-eb2a177a0e7c/main/0.log" Jul 02 16:56:52.454053 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:52.454016 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-tc7rg_62cf20c1-a717-438d-8ce6-610ec72a20c7/main/0.log" Jul 02 16:56:57.135230 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:57.135193 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bfdg7/must-gather-zv5rw"] Jul 02 16:56:57.135650 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:57.135504 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6490dd7f-879a-45be-aa8f-301c33407290" containerName="authorino" Jul 02 16:56:57.135650 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:57.135514 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6490dd7f-879a-45be-aa8f-301c33407290" containerName="authorino" Jul 02 16:56:57.135650 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:57.135569 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6490dd7f-879a-45be-aa8f-301c33407290" containerName="authorino" Jul 02 16:56:57.138557 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:57.138540 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bfdg7/must-gather-zv5rw" Jul 02 16:56:57.141127 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:57.141099 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bfdg7\"/\"kube-root-ca.crt\"" Jul 02 16:56:57.141934 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:57.141918 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bfdg7\"/\"openshift-service-ca.crt\"" Jul 02 16:56:57.142009 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:57.141936 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bfdg7\"/\"default-dockercfg-6qg7z\"" Jul 02 16:56:57.150107 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:57.150085 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bfdg7/must-gather-zv5rw"] Jul 02 16:56:57.247418 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:57.247378 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9n5k\" (UniqueName: \"kubernetes.io/projected/beec24e1-814c-4b09-a952-d2a850ab046e-kube-api-access-k9n5k\") pod \"must-gather-zv5rw\" (UID: \"beec24e1-814c-4b09-a952-d2a850ab046e\") " pod="openshift-must-gather-bfdg7/must-gather-zv5rw" Jul 02 16:56:57.247627 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:57.247424 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/beec24e1-814c-4b09-a952-d2a850ab046e-must-gather-output\") pod \"must-gather-zv5rw\" (UID: \"beec24e1-814c-4b09-a952-d2a850ab046e\") " pod="openshift-must-gather-bfdg7/must-gather-zv5rw" Jul 02 16:56:57.348783 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:57.348732 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9n5k\" (UniqueName: \"kubernetes.io/projected/beec24e1-814c-4b09-a952-d2a850ab046e-kube-api-access-k9n5k\") pod \"must-gather-zv5rw\" (UID: \"beec24e1-814c-4b09-a952-d2a850ab046e\") " pod="openshift-must-gather-bfdg7/must-gather-zv5rw" Jul 02 16:56:57.348783 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:57.348792 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/beec24e1-814c-4b09-a952-d2a850ab046e-must-gather-output\") pod \"must-gather-zv5rw\" (UID: \"beec24e1-814c-4b09-a952-d2a850ab046e\") " pod="openshift-must-gather-bfdg7/must-gather-zv5rw" Jul 02 16:56:57.349179 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:57.349158 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/beec24e1-814c-4b09-a952-d2a850ab046e-must-gather-output\") pod \"must-gather-zv5rw\" (UID: \"beec24e1-814c-4b09-a952-d2a850ab046e\") " pod="openshift-must-gather-bfdg7/must-gather-zv5rw" Jul 02 16:56:57.360338 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:57.360307 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9n5k\" (UniqueName: \"kubernetes.io/projected/beec24e1-814c-4b09-a952-d2a850ab046e-kube-api-access-k9n5k\") pod \"must-gather-zv5rw\" (UID: \"beec24e1-814c-4b09-a952-d2a850ab046e\") " pod="openshift-must-gather-bfdg7/must-gather-zv5rw" Jul 02 16:56:57.447591 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:57.447491 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bfdg7/must-gather-zv5rw" Jul 02 16:56:57.581270 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:57.581245 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bfdg7/must-gather-zv5rw"] Jul 02 16:56:57.583861 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:56:57.583830 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbeec24e1_814c_4b09_a952_d2a850ab046e.slice/crio-5fa3f3865f6521025bcc43bd87af5a19860166058e4df0c89a6c7dc0d9388290 WatchSource:0}: Error finding container 5fa3f3865f6521025bcc43bd87af5a19860166058e4df0c89a6c7dc0d9388290: Status 404 returned error can't find the container with id 5fa3f3865f6521025bcc43bd87af5a19860166058e4df0c89a6c7dc0d9388290 Jul 02 16:56:57.585818 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:57.585799 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 16:56:58.155365 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:58.155328 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bfdg7/must-gather-zv5rw" event={"ID":"beec24e1-814c-4b09-a952-d2a850ab046e","Type":"ContainerStarted","Data":"5fa3f3865f6521025bcc43bd87af5a19860166058e4df0c89a6c7dc0d9388290"} Jul 02 16:56:59.165176 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:59.165127 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bfdg7/must-gather-zv5rw" event={"ID":"beec24e1-814c-4b09-a952-d2a850ab046e","Type":"ContainerStarted","Data":"80489bf11db3a4a7667fa28e5c4abc19f88498e591b446d350583b15d8cdca3d"} Jul 02 16:56:59.165176 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:59.165179 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bfdg7/must-gather-zv5rw" event={"ID":"beec24e1-814c-4b09-a952-d2a850ab046e","Type":"ContainerStarted","Data":"0a27e44e344e89c1c03d2086c49c5d8ea9b3521243024236a9dbeba107ec69ef"} Jul 02 16:56:59.179629 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:56:59.179564 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bfdg7/must-gather-zv5rw" podStartSLOduration=1.419537418 podStartE2EDuration="2.179540442s" totalImagesPullingTime="760.003024ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 16:56:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:56:59.179290862 +0000 UTC m=+1139.096266390" watchObservedRunningTime="2026-07-02 16:56:59.179540442 +0000 UTC m=+1139.096515970" Jul 02 16:57:00.016278 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:00.016247 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s6vg5_c53fa6ea-2dd2-4c30-b86f-f6a9eca60083/global-pull-secret-syncer/0.log" Jul 02 16:57:00.105097 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:00.105062 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7575b_76cf1749-1a4a-46b2-82a8-1d70fd022f0e/konnectivity-agent/0.log" Jul 02 16:57:00.156417 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:00.156384 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-249.ec2.internal_a77a55fac5f1e674526bbab8b6258dc4/haproxy/0.log" Jul 02 16:57:05.437949 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:05.437912 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59748cd97-k9f52_416e9156-47dd-4239-8244-1fc5cc5d847a/authorino/0.log" Jul 02 16:57:05.527296 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:05.527261 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-26hmn_6485255b-11a5-46be-b71c-f68fdf7d0449/kuadrant-console-plugin/0.log" Jul 02 16:57:05.639503 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:05.639457 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-crg28_8db180be-0e9b-4497-a46c-c4b8aaad2a04/limitador/0.log" Jul 02 16:57:07.625677 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:07.625641 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-vwfv7_69404e1e-571a-4b44-abd7-707be8dee3f0/kube-state-metrics/0.log" Jul 02 16:57:07.645160 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:07.645126 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-vwfv7_69404e1e-571a-4b44-abd7-707be8dee3f0/kube-rbac-proxy-main/0.log" Jul 02 16:57:07.665892 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:07.665866 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-vwfv7_69404e1e-571a-4b44-abd7-707be8dee3f0/kube-rbac-proxy-self/0.log" Jul 02 16:57:07.845157 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:07.845129 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zbpjh_3635566c-054e-44dd-924c-777e2ca83e63/node-exporter/0.log" Jul 02 16:57:07.866394 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:07.866367 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zbpjh_3635566c-054e-44dd-924c-777e2ca83e63/kube-rbac-proxy/0.log" Jul 02 16:57:07.891517 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:07.891431 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zbpjh_3635566c-054e-44dd-924c-777e2ca83e63/init-textfile/0.log" Jul 02 16:57:10.487856 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.487821 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz"] Jul 02 16:57:10.497054 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.497022 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:10.500798 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.500773 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz"] Jul 02 16:57:10.672361 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.672306 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/967ab698-2c63-4ee3-9bda-3147d3f3ded7-sys\") pod \"perf-node-gather-daemonset-phblz\" (UID: \"967ab698-2c63-4ee3-9bda-3147d3f3ded7\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:10.672361 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.672363 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/967ab698-2c63-4ee3-9bda-3147d3f3ded7-proc\") pod \"perf-node-gather-daemonset-phblz\" (UID: \"967ab698-2c63-4ee3-9bda-3147d3f3ded7\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:10.672635 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.672395 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/967ab698-2c63-4ee3-9bda-3147d3f3ded7-lib-modules\") pod \"perf-node-gather-daemonset-phblz\" (UID: \"967ab698-2c63-4ee3-9bda-3147d3f3ded7\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:10.672635 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.672434 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mltt9\" (UniqueName: \"kubernetes.io/projected/967ab698-2c63-4ee3-9bda-3147d3f3ded7-kube-api-access-mltt9\") pod \"perf-node-gather-daemonset-phblz\" (UID: \"967ab698-2c63-4ee3-9bda-3147d3f3ded7\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:10.672635 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.672570 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/967ab698-2c63-4ee3-9bda-3147d3f3ded7-podres\") pod \"perf-node-gather-daemonset-phblz\" (UID: \"967ab698-2c63-4ee3-9bda-3147d3f3ded7\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:10.773972 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.773880 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/967ab698-2c63-4ee3-9bda-3147d3f3ded7-podres\") pod \"perf-node-gather-daemonset-phblz\" (UID: \"967ab698-2c63-4ee3-9bda-3147d3f3ded7\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:10.773972 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.773946 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/967ab698-2c63-4ee3-9bda-3147d3f3ded7-sys\") pod \"perf-node-gather-daemonset-phblz\" (UID: \"967ab698-2c63-4ee3-9bda-3147d3f3ded7\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:10.773972 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.773964 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/967ab698-2c63-4ee3-9bda-3147d3f3ded7-proc\") pod \"perf-node-gather-daemonset-phblz\" (UID: \"967ab698-2c63-4ee3-9bda-3147d3f3ded7\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:10.774282 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.773982 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/967ab698-2c63-4ee3-9bda-3147d3f3ded7-lib-modules\") pod \"perf-node-gather-daemonset-phblz\" (UID: \"967ab698-2c63-4ee3-9bda-3147d3f3ded7\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:10.774282 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.774005 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mltt9\" (UniqueName: \"kubernetes.io/projected/967ab698-2c63-4ee3-9bda-3147d3f3ded7-kube-api-access-mltt9\") pod \"perf-node-gather-daemonset-phblz\" (UID: \"967ab698-2c63-4ee3-9bda-3147d3f3ded7\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:10.774282 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.774063 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/967ab698-2c63-4ee3-9bda-3147d3f3ded7-podres\") pod \"perf-node-gather-daemonset-phblz\" (UID: \"967ab698-2c63-4ee3-9bda-3147d3f3ded7\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:10.774282 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.774086 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/967ab698-2c63-4ee3-9bda-3147d3f3ded7-proc\") pod \"perf-node-gather-daemonset-phblz\" (UID: \"967ab698-2c63-4ee3-9bda-3147d3f3ded7\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:10.774282 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.774115 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/967ab698-2c63-4ee3-9bda-3147d3f3ded7-sys\") pod \"perf-node-gather-daemonset-phblz\" (UID: \"967ab698-2c63-4ee3-9bda-3147d3f3ded7\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:10.774282 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.774146 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/967ab698-2c63-4ee3-9bda-3147d3f3ded7-lib-modules\") pod \"perf-node-gather-daemonset-phblz\" (UID: \"967ab698-2c63-4ee3-9bda-3147d3f3ded7\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:10.782053 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.782021 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mltt9\" (UniqueName: \"kubernetes.io/projected/967ab698-2c63-4ee3-9bda-3147d3f3ded7-kube-api-access-mltt9\") pod \"perf-node-gather-daemonset-phblz\" (UID: \"967ab698-2c63-4ee3-9bda-3147d3f3ded7\") " pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:10.814104 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:10.814072 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:11.013668 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:11.013612 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz"] Jul 02 16:57:11.015918 ip-10-0-134-249 kubenswrapper[2573]: W0702 16:57:11.015877 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod967ab698_2c63_4ee3_9bda_3147d3f3ded7.slice/crio-34cf0a855bb4742f002bb25a6409b18cf0ea807669a5086dcbc31d11e036927b WatchSource:0}: Error finding container 34cf0a855bb4742f002bb25a6409b18cf0ea807669a5086dcbc31d11e036927b: Status 404 returned error can't find the container with id 34cf0a855bb4742f002bb25a6409b18cf0ea807669a5086dcbc31d11e036927b Jul 02 16:57:11.238653 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:11.237802 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" event={"ID":"967ab698-2c63-4ee3-9bda-3147d3f3ded7","Type":"ContainerStarted","Data":"6dc75016df8b41cc08f6cc6962273932a5181daa135c2f2d443382d0b5c4ca86"} Jul 02 16:57:11.238653 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:11.237868 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" event={"ID":"967ab698-2c63-4ee3-9bda-3147d3f3ded7","Type":"ContainerStarted","Data":"34cf0a855bb4742f002bb25a6409b18cf0ea807669a5086dcbc31d11e036927b"} Jul 02 16:57:11.238653 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:11.238597 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:11.253508 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:11.253421 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" podStartSLOduration=1.253397193 podStartE2EDuration="1.253397193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 16:57:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 16:57:11.252265499 +0000 UTC m=+1151.169241027" watchObservedRunningTime="2026-07-02 16:57:11.253397193 +0000 UTC m=+1151.170372721" Jul 02 16:57:12.837721 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:12.837686 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p5sz6_3d2869e7-896e-4379-85b0-258330cb33eb/dns/0.log" Jul 02 16:57:12.863796 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:12.863769 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p5sz6_3d2869e7-896e-4379-85b0-258330cb33eb/kube-rbac-proxy/0.log" Jul 02 16:57:12.889499 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:12.889454 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-djv7s_a7b0f564-fcdb-46ab-a6b7-a0f73f493c6c/dns-node-resolver/0.log" Jul 02 16:57:13.485282 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:13.485249 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-d5f7d45f4-8dmjh_043bc767-adb6-4d89-bb0d-a453cf56db51/registry/0.log" Jul 02 16:57:13.492421 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:13.492393 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-d5f7d45f4-8dmjh_043bc767-adb6-4d89-bb0d-a453cf56db51/registry/1.log" Jul 02 16:57:13.514850 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:13.514822 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6hb5p_cf010754-1ca0-4088-82fe-281768fbea72/node-ca/0.log" Jul 02 16:57:14.643599 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:14.643568 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cc966699b-qns56_8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78/kube-auth-proxy/0.log" Jul 02 16:57:15.476099 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:15.476058 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zlvhw_258ea544-406e-4030-986b-26192845665f/serve-healthcheck-canary/0.log" Jul 02 16:57:16.144409 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:16.144380 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mnm4n_b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe/kube-rbac-proxy/0.log" Jul 02 16:57:16.168922 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:16.168882 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mnm4n_b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe/exporter/0.log" Jul 02 16:57:16.196665 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:16.196639 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mnm4n_b96eb3c8-45ed-4c4a-ad0c-9e634d3b05fe/extractor/0.log" Jul 02 16:57:18.258508 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:18.258447 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bfdg7/perf-node-gather-daemonset-phblz" Jul 02 16:57:18.881092 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:18.881053 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fw2cg_05a12bb3-6654-4bb4-9a00-17404c02dc1b/manager/0.log" Jul 02 16:57:19.037947 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:19.037911 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6486c9fccb-q7v4m_95687aed-a1f3-4dea-a633-3c6abdff6d35/manager/0.log" Jul 02 16:57:19.063069 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:19.063038 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6486c9fccb-q7v4m_95687aed-a1f3-4dea-a633-3c6abdff6d35/copy-manifests/0.log" Jul 02 16:57:20.822807 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:20.822773 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5bcdb6898b-twbb2_416134d9-58f1-4806-a39c-b06bd294eace/manager/0.log" Jul 02 16:57:21.067292 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:21.067263 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cc966699b-qns56_8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78/kube-auth-proxy/0.log" Jul 02 16:57:22.452204 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:22.452168 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cc966699b-qns56_8b53e79a-3e63-4012-bcc8-4f1f0a3a3a78/kube-auth-proxy/0.log" Jul 02 16:57:27.157431 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:27.157390 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5v4fr_a86fe19d-9b81-40d7-8dfc-cf3ff4981bcb/kube-multus/0.log" Jul 02 16:57:27.539228 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:27.539151 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zlxgn_156cb232-e7c6-4352-b91f-26673a603734/kube-multus-additional-cni-plugins/0.log" Jul 02 16:57:27.563320 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:27.563294 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zlxgn_156cb232-e7c6-4352-b91f-26673a603734/egress-router-binary-copy/0.log" Jul 02 16:57:27.585758 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:27.585730 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zlxgn_156cb232-e7c6-4352-b91f-26673a603734/cni-plugins/0.log" Jul 02 16:57:27.608317 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:27.608286 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zlxgn_156cb232-e7c6-4352-b91f-26673a603734/bond-cni-plugin/0.log" Jul 02 16:57:27.632436 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:27.632409 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zlxgn_156cb232-e7c6-4352-b91f-26673a603734/routeoverride-cni/0.log" Jul 02 16:57:27.653342 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:27.653315 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zlxgn_156cb232-e7c6-4352-b91f-26673a603734/whereabouts-cni-bincopy/0.log" Jul 02 16:57:27.673415 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:27.673384 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zlxgn_156cb232-e7c6-4352-b91f-26673a603734/whereabouts-cni/0.log" Jul 02 16:57:27.727277 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:27.727252 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nxkt7_89ea8114-cf19-48eb-a43f-1ea418757a27/network-metrics-daemon/0.log" Jul 02 16:57:27.747610 ip-10-0-134-249 kubenswrapper[2573]: I0702 16:57:27.747576 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nxkt7_89ea8114-cf19-48eb-a43f-1ea418757a27/kube-rbac-proxy/0.log"