Jul 08 19:32:26.535052 ip-10-0-138-108 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 19:32:26.535064 ip-10-0-138-108 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 19:32:26.535073 ip-10-0-138-108 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 19:32:26.535505 ip-10-0-138-108 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 19:32:36.576018 ip-10-0-138-108 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 19:32:36.576033 ip-10-0-138-108 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5205bac8a9214f2d97f6d46d9f88e072 -- Jul 08 19:34:38.143750 ip-10-0-138-108 systemd[1]: Starting Kubernetes Kubelet... Jul 08 19:34:38.495849 ip-10-0-138-108 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 19:34:38.495849 ip-10-0-138-108 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 19:34:38.495849 ip-10-0-138-108 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 19:34:38.495849 ip-10-0-138-108 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 19:34:38.495849 ip-10-0-138-108 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 19:34:38.498111 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.498018 2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 19:34:38.502423 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502406 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:34:38.502460 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502425 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:34:38.502460 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502430 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:34:38.502460 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502433 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:34:38.502460 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502437 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:34:38.502460 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502440 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:34:38.502460 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502443 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:34:38.502460 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502446 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:34:38.502460 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502449 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:34:38.502460 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502451 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:34:38.502460 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502454 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:34:38.502460 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502458 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:34:38.502460 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502461 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:34:38.502460 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502464 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:34:38.502460 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502468 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502471 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502474 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502477 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502480 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502483 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502485 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502488 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502491 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502495 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502498 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502500 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502503 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502506 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502523 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502527 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502530 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502532 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502535 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502538 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:34:38.502832 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502540 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502543 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502546 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502548 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502551 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502554 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502556 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502559 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502562 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502565 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502568 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502570 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502573 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502577 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502580 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502583 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502586 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502588 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502591 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502594 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:34:38.503343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502606 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502609 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502612 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502616 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502621 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502624 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502627 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502630 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502633 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502636 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502640 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502642 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502645 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502648 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502651 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502653 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502656 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502659 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502663 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:34:38.503865 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502666 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502668 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502671 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502675 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502679 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502682 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502686 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502689 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502692 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502695 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502698 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502700 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502703 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502706 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502709 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502712 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502715 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502717 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502720 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:34:38.504343 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502723 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:34:38.504872 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502725 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:34:38.504872 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502728 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:34:38.504872 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502730 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:34:38.504872 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502734 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:34:38.504872 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502736 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:34:38.504872 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.502740 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:34:38.504872 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503531 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:34:38.504872 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503541 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:34:38.504872 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503544 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:34:38.504872 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503549 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:34:38.504872 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503553 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:34:38.504872 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503557 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:34:38.504872 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503562 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:34:38.504872 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503567 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:34:38.504872 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503570 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:34:38.504872 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503573 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:34:38.504872 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503576 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:34:38.504872 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503579 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503583 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503587 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503590 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503593 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503596 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503599 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503602 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503605 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503608 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503611 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503614 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503617 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503620 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503623 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503626 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503628 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503631 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503634 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503637 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:34:38.505391 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503640 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503643 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503645 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503648 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503651 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503655 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503657 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503660 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503663 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503667 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503670 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503673 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503676 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503679 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503682 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503685 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503688 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503690 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503693 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503696 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:34:38.505937 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503698 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503701 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503703 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503706 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503709 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503711 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503714 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503717 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503720 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503723 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503728 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503732 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503734 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503738 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503740 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503743 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503745 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503749 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503751 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503754 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:34:38.506452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503757 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503760 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503763 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503765 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503768 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503771 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503775 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503778 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503781 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503784 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503787 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503789 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503792 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503795 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503797 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503800 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503803 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503806 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503809 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503811 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:34:38.506982 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503814 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503817 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503820 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503823 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503825 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503828 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503831 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.503834 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504302 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504309 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504312 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504316 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504323 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504327 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504330 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504332 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504336 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504339 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504342 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504346 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:34:38.507496 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504349 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504352 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504356 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504359 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504361 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504364 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504367 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504370 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504373 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504376 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504378 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504381 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504384 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504387 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504389 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504392 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504395 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504397 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504400 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:34:38.508024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504403 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504407 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504411 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504414 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504416 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504419 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504424 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504427 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504430 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504433 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504436 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504439 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504442 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504445 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504448 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504450 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504453 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504457 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504461 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:34:38.508524 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504464 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504467 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504470 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504473 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504476 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504479 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504482 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504485 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504488 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504490 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504493 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504497 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504501 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504504 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504521 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504525 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504528 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504531 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504534 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504537 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:34:38.509010 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504547 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504551 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504553 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504556 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504559 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504562 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504564 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504567 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504570 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504574 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504577 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504579 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504582 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504585 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504588 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504591 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504593 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504596 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504599 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504602 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:34:38.509526 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504604 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504607 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504609 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504612 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504615 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504618 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504622 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504625 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.504628 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504700 2553 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504708 2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504742 2553 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504748 2553 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504759 2553 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504763 2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504768 2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504772 2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504776 2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504779 2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504782 2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504786 2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504790 2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 19:34:38.510050 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504793 2553 flags.go:64] FLAG: --cgroup-root="" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504796 2553 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504799 2553 flags.go:64] FLAG: --client-ca-file="" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504803 2553 flags.go:64] FLAG: --cloud-provider="external" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504806 2553 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504811 2553 flags.go:64] FLAG: --cluster-domain="" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504815 2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504818 2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504821 2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504825 2553 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504829 2553 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504832 2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504835 2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504839 2553 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504842 2553 flags.go:64] FLAG: --contention-profiling="false" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504848 2553 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504851 2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504854 2553 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504857 2553 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504862 2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504869 2553 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504872 2553 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504876 2553 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504879 2553 flags.go:64] FLAG: --enable-server="true" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504883 2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 19:34:38.510661 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504888 2553 flags.go:64] FLAG: --event-burst="100" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504892 2553 flags.go:64] FLAG: --event-qps="50" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504895 2553 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504898 2553 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504901 2553 flags.go:64] FLAG: --eviction-hard="" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504905 2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504909 2553 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504912 2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504915 2553 flags.go:64] FLAG: --eviction-soft="" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504918 2553 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504921 2553 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504924 2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504927 2553 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504930 2553 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504933 2553 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504937 2553 flags.go:64] FLAG: --feature-gates="" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504943 2553 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504948 2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504954 2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504958 2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504961 2553 flags.go:64] FLAG: --healthz-port="10248" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504964 2553 flags.go:64] FLAG: --help="false" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504970 2553 flags.go:64] FLAG: --hostname-override="ip-10-0-138-108.ec2.internal" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504973 2553 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 19:34:38.511343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504977 2553 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504980 2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504983 2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504987 2553 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504990 2553 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504993 2553 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.504997 2553 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505000 2553 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505004 2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505007 2553 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505010 2553 flags.go:64] FLAG: --kube-reserved="" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505013 2553 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505016 2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505019 2553 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505022 2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505025 2553 flags.go:64] FLAG: --lock-file="" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505028 2553 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505031 2553 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505034 2553 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505040 2553 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505043 2553 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505046 2553 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505049 2553 flags.go:64] FLAG: --logging-format="text" Jul 08 19:34:38.512021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505052 2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505056 2553 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505059 2553 flags.go:64] FLAG: --manifest-url="" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505062 2553 flags.go:64] FLAG: --manifest-url-header="" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505066 2553 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505069 2553 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505073 2553 flags.go:64] FLAG: --max-pods="110" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505079 2553 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505082 2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505086 2553 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505089 2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505092 2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505095 2553 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505098 2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505107 2553 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505110 2553 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505114 2553 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505117 2553 flags.go:64] FLAG: --pod-cidr="" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505121 2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505127 2553 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505130 2553 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505133 2553 flags.go:64] FLAG: --pods-per-core="0" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505136 2553 flags.go:64] FLAG: --port="10250" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505140 2553 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 19:34:38.512636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505143 2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01cdea6c823878910" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505146 2553 flags.go:64] FLAG: --qos-reserved="" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505149 2553 flags.go:64] FLAG: --read-only-port="10255" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505152 2553 flags.go:64] FLAG: --register-node="true" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505155 2553 flags.go:64] FLAG: --register-with-taints="" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505159 2553 flags.go:64] FLAG: --registry-burst="10" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505162 2553 flags.go:64] FLAG: --registry-qps="5" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505166 2553 flags.go:64] FLAG: --reserved-cpus="" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505169 2553 flags.go:64] FLAG: --reserved-memory="" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505173 2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505176 2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505180 2553 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505183 2553 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505186 2553 flags.go:64] FLAG: --runonce="false" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505189 2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505192 2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505197 2553 flags.go:64] FLAG: --seccomp-default="false" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505200 2553 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505203 2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505206 2553 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505210 2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505213 2553 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505216 2553 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505219 2553 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505222 2553 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505225 2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 19:34:38.513259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505228 2553 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505232 2553 flags.go:64] FLAG: --system-cgroups="" Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505235 2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505241 2553 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505244 2553 flags.go:64] FLAG: --tls-cert-file="" Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505247 2553 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505252 2553 flags.go:64] FLAG: --tls-min-version="" Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505255 2553 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505258 2553 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505261 2553 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505264 2553 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505267 2553 flags.go:64] FLAG: --v="2" Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505272 2553 flags.go:64] FLAG: --version="false" Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505276 2553 flags.go:64] FLAG: --vmodule="" Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505280 2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.505284 2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505406 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505410 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505413 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505416 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505419 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505423 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505428 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:34:38.513961 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505431 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505434 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505437 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505440 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505443 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505445 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505448 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505451 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505454 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505457 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505459 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505463 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505467 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505471 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505476 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505479 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505482 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505485 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505488 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:34:38.514610 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505491 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505494 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505497 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505499 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505502 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505505 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505524 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505528 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505530 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505533 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505536 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505539 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505544 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505547 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505549 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505552 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505555 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505558 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505561 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505564 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:34:38.515111 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505567 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505569 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505572 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505575 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505579 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505585 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505588 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505591 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505594 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505597 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505599 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505602 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505606 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505610 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505613 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505615 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505618 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505621 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505624 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505627 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:34:38.515652 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505629 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505632 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505635 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505637 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505642 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505644 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505647 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505650 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505653 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505656 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505659 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505661 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505664 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505667 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505670 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505673 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505676 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505680 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505683 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505686 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:34:38.516173 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505689 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:34:38.516749 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505691 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:34:38.516749 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505694 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:34:38.516749 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505697 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:34:38.516749 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505700 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:34:38.516749 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505703 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:34:38.516749 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505705 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:34:38.516749 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505708 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:34:38.516749 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505711 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:34:38.516749 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505713 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:34:38.516749 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505716 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:34:38.516749 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505718 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:34:38.516749 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.505721 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:34:38.516749 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.506246 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 19:34:38.516749 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.514987 2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 19:34:38.516749 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.515004 2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.515026 2553 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.515033 2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515095 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515100 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515104 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515108 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515111 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515115 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515118 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515121 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515125 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515128 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515131 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515133 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515136 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515139 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515142 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515144 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:34:38.517154 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515147 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515150 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515153 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515157 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515161 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515164 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515167 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515171 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515174 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515177 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515180 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515183 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515185 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515190 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515193 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515195 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515198 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515201 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515204 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515207 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:34:38.517656 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515209 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515212 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515215 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515217 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515220 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515223 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515225 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515228 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515231 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515234 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515237 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515239 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515242 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515246 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515250 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515253 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515256 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515259 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515262 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515265 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:34:38.518160 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515268 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515270 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515273 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515276 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515279 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515283 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515287 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515289 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515293 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515296 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515298 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515302 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515304 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515307 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515311 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515315 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515318 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515321 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515324 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515327 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:34:38.518683 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515329 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515332 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515335 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515337 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515340 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515343 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515346 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515349 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515351 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515354 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515357 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515359 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515362 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515365 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515368 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515371 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515373 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515377 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515380 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515383 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:34:38.519201 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515386 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:34:38.519810 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515389 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:34:38.519810 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515391 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:34:38.519810 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.515396 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 19:34:38.519810 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515537 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:34:38.519810 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515543 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:34:38.519810 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515546 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:34:38.519810 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515549 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:34:38.519810 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515552 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:34:38.519810 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515555 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:34:38.519810 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515558 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:34:38.519810 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515561 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:34:38.519810 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515564 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:34:38.519810 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515566 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:34:38.519810 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515569 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:34:38.519810 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515572 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515575 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515580 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515584 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515588 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515591 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515594 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515596 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515599 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515602 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515605 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515608 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515611 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515613 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515617 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515619 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515622 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515625 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515628 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:34:38.520247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515631 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515634 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515636 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515639 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515642 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515644 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515647 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515650 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515652 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515655 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515658 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515661 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515664 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515667 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515670 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515672 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515675 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515678 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515681 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515683 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:34:38.520781 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515686 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515689 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515691 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515694 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515697 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515699 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515702 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515705 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515708 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515711 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515713 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515716 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515719 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515722 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515724 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515727 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515730 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515732 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515735 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515737 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:34:38.521293 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515740 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515744 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515748 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515750 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515753 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515756 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515758 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515761 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515764 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515767 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515769 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515772 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515776 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515780 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515783 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515787 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515790 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515793 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515796 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:34:38.521952 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515800 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:34:38.522433 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515803 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:34:38.522433 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515806 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:34:38.522433 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515809 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:34:38.522433 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515811 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:34:38.522433 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515815 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:34:38.522433 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515817 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:34:38.522433 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515821 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:34:38.522433 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515823 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:34:38.522433 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:38.515826 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:34:38.522433 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.515832 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 19:34:38.522433 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.515945 2553 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 19:34:38.522433 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.518043 2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 19:34:38.522433 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.519448 2553 server.go:1019] "Starting client certificate rotation" Jul 08 19:34:38.522433 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.519554 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 19:34:38.522817 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.519625 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 19:34:38.522956 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.522941 2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 19:34:38.528261 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.528236 2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 19:34:38.535439 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.535418 2553 log.go:25] "Validated CRI v1 runtime API" Jul 08 19:34:38.537552 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.537537 2553 log.go:25] "Validated CRI v1 image API" Jul 08 19:34:38.538440 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.538420 2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 19:34:38.542602 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.542573 2553 fs.go:135] Filesystem UUIDs: map[3c35a987-e12d-48de-ab09-a226b23d79ef:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f5175fa3-2a83-4df3-bf4b-ff4a8235a638:/dev/nvme0n1p3] Jul 08 19:34:38.542664 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.542602 2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 19:34:38.547813 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.547692 2553 manager.go:216] Machine: {Timestamp:2026-07-08 19:34:38.54658206 +0000 UTC m=+0.300226295 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100916 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e58b72aaeb2df7f4e291d3a875439 SystemUUID:ec2e58b7-2aae-b2df-7f4e-291d3a875439 BootID:5205bac8-a921-4f2d-97f6-d46d9f88e072 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:62:fd:43:3c:39 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:62:fd:43:3c:39 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:3a:69:f7:67:60 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 19:34:38.547813 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.547807 2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 19:34:38.547922 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.547891 2553 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 19:34:38.548939 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.548914 2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 19:34:38.549081 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.548941 2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-108.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 19:34:38.550134 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.550120 2553 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 19:34:38.550174 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.550140 2553 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 19:34:38.550174 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.550149 2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 19:34:38.550723 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.550711 2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 19:34:38.552033 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.552022 2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 19:34:38.552445 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.552429 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 19:34:38.555383 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.555366 2553 state_mem.go:36] "Initialized new in-memory state store" Jul 08 19:34:38.555500 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.555489 2553 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 19:34:38.555567 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.555541 2553 kubelet.go:486] "Attempting to sync node with API server" Jul 08 19:34:38.555567 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.555554 2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 19:34:38.555624 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.555569 2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 19:34:38.555624 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.555580 2553 kubelet.go:398] "Adding apiserver pod source" Jul 08 19:34:38.555624 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.555590 2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 19:34:38.555970 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.555954 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 19:34:38.556028 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.555979 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 19:34:38.559352 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.559335 2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 19:34:38.562245 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.562229 2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 19:34:38.562291 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.562273 2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 19:34:38.563321 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.563307 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 19:34:38.563374 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.563326 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 19:34:38.563374 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.563333 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 19:34:38.563374 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.563339 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 19:34:38.563374 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.563348 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 19:34:38.563374 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.563355 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 19:34:38.563374 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.563363 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 19:34:38.563374 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.563369 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 19:34:38.563374 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.563377 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 19:34:38.563631 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.563383 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 19:34:38.563631 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.563398 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 19:34:38.563631 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.563403 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 19:34:38.564017 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.564005 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 19:34:38.564052 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.564019 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 19:34:38.567852 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.567831 2553 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-108.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 19:34:38.567998 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.567986 2553 server.go:1268] "Started kubelet" Jul 08 19:34:38.573364 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.573328 2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 19:34:38.573435 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.573398 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 19:34:38.573500 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.573445 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-108.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 19:34:38.573927 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.573862 2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 19:34:38.574001 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.573956 2553 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 19:34:38.574158 ip-10-0-138-108 systemd[1]: Started Kubernetes Kubelet. Jul 08 19:34:38.575853 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.575827 2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 19:34:38.577146 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.577118 2553 server.go:310] "Adding debug handlers to kubelet server" Jul 08 19:34:38.579971 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.579948 2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 19:34:38.580948 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.580163 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-108.ec2.internal.18c0678635ffe4a5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-108.ec2.internal,UID:ip-10-0-138-108.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-108.ec2.internal,},FirstTimestamp:2026-07-08 19:34:38.567957669 +0000 UTC m=+0.321601951,LastTimestamp:2026-07-08 19:34:38.567957669 +0000 UTC m=+0.321601951,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-108.ec2.internal,}" Jul 08 19:34:38.582998 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.582979 2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 19:34:38.582998 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.582990 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 19:34:38.583175 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.583135 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-108.ec2.internal\" not found" Jul 08 19:34:38.583746 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.583720 2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 19:34:38.584074 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.583731 2553 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 19:34:38.584275 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.584263 2553 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 19:34:38.584363 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.584145 2553 factory.go:153] Registering CRI-O factory Jul 08 19:34:38.584419 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.584372 2553 factory.go:223] Registration of the crio container factory successfully Jul 08 19:34:38.584488 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.584431 2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 19:34:38.584488 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.584444 2553 factory.go:55] Registering systemd factory Jul 08 19:34:38.584488 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.584452 2553 factory.go:223] Registration of the systemd container factory successfully Jul 08 19:34:38.584625 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.584492 2553 reconstruct.go:97] "Volume reconstruction finished" Jul 08 19:34:38.584625 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.584499 2553 factory.go:103] Registering Raw factory Jul 08 19:34:38.584625 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.584502 2553 reconciler.go:29] "Reconciler: start to sync state" Jul 08 19:34:38.584625 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.584517 2553 manager.go:1196] Started watching for new ooms in manager Jul 08 19:34:38.584787 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.584650 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n9hdn" Jul 08 19:34:38.586904 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.585211 2553 manager.go:349] Starting recovery of all containers Jul 08 19:34:38.589843 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.589813 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 19:34:38.589949 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.589913 2553 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-108.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 19:34:38.594699 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.594524 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n9hdn" Jul 08 19:34:38.594842 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.594824 2553 manager.go:354] Recovery completed Jul 08 19:34:38.596497 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.596470 2553 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 08 19:34:38.601078 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.601048 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:34:38.603015 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.602997 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:34:38.603086 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.603028 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:34:38.603086 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.603039 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:34:38.603672 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.603648 2553 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 19:34:38.603672 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.603662 2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 19:34:38.603768 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.603680 2553 state_mem.go:36] "Initialized new in-memory state store" Jul 08 19:34:38.603768 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.603689 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:34:38.604394 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.604378 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:34:38.604468 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.604407 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:34:38.604468 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.604416 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:34:38.605059 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.605046 2553 policy_none.go:49] "None policy: Start" Jul 08 19:34:38.605114 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.605063 2553 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 19:34:38.605114 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.605074 2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 19:34:38.605511 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.605424 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-108.ec2.internal.18c067863816cef3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-108.ec2.internal,UID:ip-10-0-138-108.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-108.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-108.ec2.internal,},FirstTimestamp:2026-07-08 19:34:38.603013875 +0000 UTC m=+0.356658109,LastTimestamp:2026-07-08 19:34:38.603013875 +0000 UTC m=+0.356658109,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-108.ec2.internal,}" Jul 08 19:34:38.606223 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.606204 2553 policy_none.go:47] "Start" Jul 08 19:34:38.644176 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.644154 2553 manager.go:337] "Starting Device Plugin manager" Jul 08 19:34:38.644280 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.644194 2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 19:34:38.644280 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.644207 2553 server.go:87] "Starting device plugin registration server" Jul 08 19:34:38.644474 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.644460 2553 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 19:34:38.644539 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.644483 2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 19:34:38.644610 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.644589 2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 19:34:38.644714 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.644699 2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 19:34:38.644782 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.644717 2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 19:34:38.645300 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.645276 2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 19:34:38.645393 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.645325 2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-108.ec2.internal\" not found" Jul 08 19:34:38.745779 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.745695 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:34:38.746938 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.746829 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:34:38.746938 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.746861 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:34:38.746938 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.746873 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:34:38.746938 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.746918 2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-108.ec2.internal" Jul 08 19:34:38.754635 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.754617 2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-108.ec2.internal" Jul 08 19:34:38.754689 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.754640 2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-108.ec2.internal\": node \"ip-10-0-138-108.ec2.internal\" not found" Jul 08 19:34:38.770460 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.770433 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 19:34:38.771805 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.771779 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 19:34:38.771870 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.771828 2553 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 19:34:38.771870 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.771850 2553 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 19:34:38.771964 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.771889 2553 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 19:34:38.774684 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.774664 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:34:38.776136 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.776112 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-108.ec2.internal\" not found" Jul 08 19:34:38.874844 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.874795 2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-108.ec2.internal"] Jul 08 19:34:38.875027 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.874891 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:34:38.876498 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.876477 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-108.ec2.internal\" not found" Jul 08 19:34:38.876911 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.876885 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:34:38.877021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.876924 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:34:38.877021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.876942 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:34:38.878316 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.878302 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:34:38.878500 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.878486 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal" Jul 08 19:34:38.878555 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.878522 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:34:38.879087 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.879070 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:34:38.879087 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.879081 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:34:38.879173 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.879094 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:34:38.879173 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.879099 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:34:38.879173 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.879105 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:34:38.879173 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.879110 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:34:38.880323 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.880306 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-108.ec2.internal" Jul 08 19:34:38.880419 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.880334 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:34:38.881073 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.881054 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:34:38.881164 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.881084 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:34:38.881164 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.881095 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:34:38.884891 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.884872 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b7ec4acbf852e2b07ece08ecc1022c7c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-108.ec2.internal\" (UID: \"b7ec4acbf852e2b07ece08ecc1022c7c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-108.ec2.internal" Jul 08 19:34:38.884993 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.884896 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/305d9cf3b9e0fa073efd5151ba0d6bd1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal\" (UID: \"305d9cf3b9e0fa073efd5151ba0d6bd1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal" Jul 08 19:34:38.884993 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.884919 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/305d9cf3b9e0fa073efd5151ba0d6bd1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal\" (UID: \"305d9cf3b9e0fa073efd5151ba0d6bd1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal" Jul 08 19:34:38.904183 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.904155 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-108.ec2.internal\" not found" node="ip-10-0-138-108.ec2.internal" Jul 08 19:34:38.908787 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.908770 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-108.ec2.internal\" not found" node="ip-10-0-138-108.ec2.internal" Jul 08 19:34:38.977313 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:38.977281 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-108.ec2.internal\" not found" Jul 08 19:34:38.988934 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.985172 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/305d9cf3b9e0fa073efd5151ba0d6bd1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal\" (UID: \"305d9cf3b9e0fa073efd5151ba0d6bd1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal" Jul 08 19:34:38.988934 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.985200 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/305d9cf3b9e0fa073efd5151ba0d6bd1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal\" (UID: \"305d9cf3b9e0fa073efd5151ba0d6bd1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal" Jul 08 19:34:38.988934 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.985219 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b7ec4acbf852e2b07ece08ecc1022c7c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-108.ec2.internal\" (UID: \"b7ec4acbf852e2b07ece08ecc1022c7c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-108.ec2.internal" Jul 08 19:34:38.988934 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.985226 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/305d9cf3b9e0fa073efd5151ba0d6bd1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal\" (UID: \"305d9cf3b9e0fa073efd5151ba0d6bd1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal" Jul 08 19:34:38.988934 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.985256 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b7ec4acbf852e2b07ece08ecc1022c7c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-108.ec2.internal\" (UID: \"b7ec4acbf852e2b07ece08ecc1022c7c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-108.ec2.internal" Jul 08 19:34:38.988934 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:38.985279 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/305d9cf3b9e0fa073efd5151ba0d6bd1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal\" (UID: \"305d9cf3b9e0fa073efd5151ba0d6bd1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal" Jul 08 19:34:39.078872 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:39.078794 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-108.ec2.internal\" not found" Jul 08 19:34:39.180020 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:39.179987 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-108.ec2.internal\" not found" Jul 08 19:34:39.207767 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:39.207723 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal" Jul 08 19:34:39.212283 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:39.212004 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-108.ec2.internal" Jul 08 19:34:39.280454 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:39.280411 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-108.ec2.internal\" not found" Jul 08 19:34:39.380612 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:39.380537 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-108.ec2.internal\" not found" Jul 08 19:34:39.481335 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:39.481291 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-108.ec2.internal\" not found" Jul 08 19:34:39.519533 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:39.519502 2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 19:34:39.520204 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:39.519673 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 19:34:39.539259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:39.539227 2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:34:39.581739 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:39.581715 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-108.ec2.internal\" not found" Jul 08 19:34:39.596968 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:39.596923 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 19:29:39 +0000 UTC" deadline="2028-04-21 08:15:04.463871524 +0000 UTC" Jul 08 19:34:39.596968 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:39.596959 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15660h40m24.866915845s" Jul 08 19:34:39.610037 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:39.610020 2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:34:39.681906 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:39.681873 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-108.ec2.internal\" not found" Jul 08 19:34:39.756164 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:39.756119 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7ec4acbf852e2b07ece08ecc1022c7c.slice/crio-d8feb05912cfd465f09d3599ce2583ddb900924b4dde9d5067116ec1f6cc10bf WatchSource:0}: Error finding container d8feb05912cfd465f09d3599ce2583ddb900924b4dde9d5067116ec1f6cc10bf: Status 404 returned error can't find the container with id d8feb05912cfd465f09d3599ce2583ddb900924b4dde9d5067116ec1f6cc10bf Jul 08 19:34:39.760467 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:39.760433 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:34:39.775446 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:39.775400 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-108.ec2.internal" event={"ID":"b7ec4acbf852e2b07ece08ecc1022c7c","Type":"ContainerStarted","Data":"d8feb05912cfd465f09d3599ce2583ddb900924b4dde9d5067116ec1f6cc10bf"} Jul 08 19:34:39.782573 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:39.782552 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-108.ec2.internal\" not found" Jul 08 19:34:39.794239 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:39.794214 2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:34:39.866883 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:39.866855 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod305d9cf3b9e0fa073efd5151ba0d6bd1.slice/crio-538b30f74bd494ac9c78b911fb693b52ff9c232d465f8caea0dce09045958e37 WatchSource:0}: Error finding container 538b30f74bd494ac9c78b911fb693b52ff9c232d465f8caea0dce09045958e37: Status 404 returned error can't find the container with id 538b30f74bd494ac9c78b911fb693b52ff9c232d465f8caea0dce09045958e37 Jul 08 19:34:39.883295 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:39.883271 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal" Jul 08 19:34:39.907739 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:39.907719 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 19:34:39.908873 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:39.908857 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-108.ec2.internal" Jul 08 19:34:39.936823 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:39.936760 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 19:34:40.557770 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.557737 2553 apiserver.go:52] "Watching apiserver" Jul 08 19:34:40.567962 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.567935 2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 19:34:40.569709 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.569683 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal","openshift-multus/multus-additional-cni-plugins-grmlv","openshift-multus/network-metrics-daemon-4n4kl","openshift-network-diagnostics/network-check-target-nctzg","openshift-ovn-kubernetes/ovnkube-node-c9rnh","kube-system/global-pull-secret-syncer-lrxb5","kube-system/kube-apiserver-proxy-ip-10-0-138-108.ec2.internal","openshift-cluster-node-tuning-operator/tuned-7g4xw","openshift-dns/node-resolver-krhqb","openshift-multus/multus-j2mdw","openshift-network-operator/iptables-alerter-m9w7f","kube-system/konnectivity-agent-r8d4l","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk","openshift-image-registry/node-ca-qgvpz"] Jul 08 19:34:40.571470 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.571430 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.572879 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.572858 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.574308 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.574285 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 19:34:40.574414 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.574294 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 19:34:40.574486 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.574414 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 19:34:40.574486 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.574418 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 19:34:40.574722 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.574702 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-blzds\"" Jul 08 19:34:40.575435 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.575412 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:40.575578 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:40.575543 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:34:40.575715 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.575603 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 19:34:40.575897 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.575874 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 19:34:40.576000 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.575907 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 19:34:40.576195 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.576172 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lb7wv\"" Jul 08 19:34:40.576913 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.576892 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:34:40.577011 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:40.576983 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nctzg" podUID="22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d" Jul 08 19:34:40.578573 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.578551 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.579878 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.579860 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:40.579982 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:40.579926 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrxb5" podUID="1fca35f1-b001-4ddc-99dd-c7069213abfb" Jul 08 19:34:40.581035 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.580987 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 19:34:40.581166 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.581039 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 19:34:40.581669 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.581358 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 19:34:40.581669 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.581403 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 19:34:40.581669 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.581666 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-krhqb" Jul 08 19:34:40.582849 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.582829 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 19:34:40.582953 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.582915 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 19:34:40.583075 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.583058 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zmwcl\"" Jul 08 19:34:40.583175 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.583156 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qgvpz" Jul 08 19:34:40.584542 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.584521 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 19:34:40.585785 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.585232 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 19:34:40.585785 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.585359 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 19:34:40.585785 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.585711 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-69nct\"" Jul 08 19:34:40.586165 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.586120 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 19:34:40.586260 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.586235 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6fwkd\"" Jul 08 19:34:40.587480 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.586506 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.587480 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.586548 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 19:34:40.587480 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.586630 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 19:34:40.589228 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.589206 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nprs9\"" Jul 08 19:34:40.589409 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.589386 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.589497 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.589419 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 19:34:40.589620 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.589424 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 19:34:40.592567 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.592201 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m9w7f" Jul 08 19:34:40.592777 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.592760 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5zvrd\"" Jul 08 19:34:40.592982 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.592963 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:34:40.593110 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.593092 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 19:34:40.593803 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.593785 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r8d4l" Jul 08 19:34:40.594253 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594230 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-host-var-lib-cni-multus\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.594348 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594284 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmjg2\" (UniqueName: \"kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2\") pod \"network-check-target-nctzg\" (UID: \"22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d\") " pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:34:40.594348 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594328 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7fd354ff-50fe-4094-9b62-0d3242209b02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.594447 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594355 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-systemd-units\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.594447 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594382 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef87ff27-5173-4a5f-b14c-036905e7d02b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.594447 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594406 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1fca35f1-b001-4ddc-99dd-c7069213abfb-dbus\") pod \"global-pull-secret-syncer-lrxb5\" (UID: \"1fca35f1-b001-4ddc-99dd-c7069213abfb\") " pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:40.594582 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594447 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-ovnkube-config\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.594582 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594475 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef87ff27-5173-4a5f-b14c-036905e7d02b-cnibin\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.594582 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594499 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/677911c6-add4-47b7-8d4f-4cac25373bfa-cni-binary-copy\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.594582 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594551 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-host-run-netns\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.594782 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594604 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6d5l\" (UniqueName: \"kubernetes.io/projected/677911c6-add4-47b7-8d4f-4cac25373bfa-kube-api-access-z6d5l\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.594782 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594632 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-etc-openvswitch\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.594782 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594665 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-run-openvswitch\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.594782 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594714 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-run-ovn\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.594782 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594740 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef87ff27-5173-4a5f-b14c-036905e7d02b-cni-binary-copy\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.594782 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594750 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:34:40.594782 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594764 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-log-socket\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.595094 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594788 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-ovn-node-metrics-cert\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.595094 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594815 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqrmz\" (UniqueName: \"kubernetes.io/projected/ef87ff27-5173-4a5f-b14c-036905e7d02b-kube-api-access-fqrmz\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.595094 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594862 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-host-run-multus-certs\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.595094 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594889 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqsk8\" (UniqueName: \"kubernetes.io/projected/ee19b31b-83ec-4cfd-9028-53489b1b36e2-kube-api-access-rqsk8\") pod \"node-ca-qgvpz\" (UID: \"ee19b31b-83ec-4cfd-9028-53489b1b36e2\") " pod="openshift-image-registry/node-ca-qgvpz" Jul 08 19:34:40.595094 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594913 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7fd354ff-50fe-4094-9b62-0d3242209b02-device-dir\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.595094 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.594939 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-run-systemd\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.595094 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595017 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-cnibin\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.595094 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595043 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-host-var-lib-kubelet\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.595094 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595069 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-etc-kubernetes\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.595558 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595095 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjbgk\" (UniqueName: \"kubernetes.io/projected/7fd354ff-50fe-4094-9b62-0d3242209b02-kube-api-access-kjbgk\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.595558 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595147 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-var-lib-openvswitch\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.595558 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595185 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e507492c-7b39-427a-b189-5317fd33c4f4-hosts-file\") pod \"node-resolver-krhqb\" (UID: \"e507492c-7b39-427a-b189-5317fd33c4f4\") " pod="openshift-dns/node-resolver-krhqb" Jul 08 19:34:40.595558 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595210 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tjjf\" (UniqueName: \"kubernetes.io/projected/e507492c-7b39-427a-b189-5317fd33c4f4-kube-api-access-7tjjf\") pod \"node-resolver-krhqb\" (UID: \"e507492c-7b39-427a-b189-5317fd33c4f4\") " pod="openshift-dns/node-resolver-krhqb" Jul 08 19:34:40.595558 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595234 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-os-release\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.595558 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595270 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-host-run-k8s-cni-cncf-io\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.595558 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595296 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef87ff27-5173-4a5f-b14c-036905e7d02b-os-release\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.595558 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595322 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-multus-cni-dir\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.595558 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595346 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-multus-socket-dir-parent\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.595558 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595355 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 19:34:40.595558 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595371 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee19b31b-83ec-4cfd-9028-53489b1b36e2-host\") pod \"node-ca-qgvpz\" (UID: \"ee19b31b-83ec-4cfd-9028-53489b1b36e2\") " pod="openshift-image-registry/node-ca-qgvpz" Jul 08 19:34:40.595558 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595421 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4trnl\" (UniqueName: \"kubernetes.io/projected/df97169f-20ad-4b99-b6c8-9cec807f0296-kube-api-access-4trnl\") pod \"network-metrics-daemon-4n4kl\" (UID: \"df97169f-20ad-4b99-b6c8-9cec807f0296\") " pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:40.595558 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595459 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzxrb\" (UniqueName: \"kubernetes.io/projected/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-kube-api-access-jzxrb\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.595558 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595484 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7fd354ff-50fe-4094-9b62-0d3242209b02-registration-dir\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.595558 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595552 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.596264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595608 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-ovnkube-script-lib\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.596264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595621 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qsdmd\"" Jul 08 19:34:40.596264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595638 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-system-cni-dir\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.596264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595661 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-hostroot\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.596264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595688 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-run-netns\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.596264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595713 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/677911c6-add4-47b7-8d4f-4cac25373bfa-multus-daemon-config\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.596264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595738 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret\") pod \"global-pull-secret-syncer-lrxb5\" (UID: \"1fca35f1-b001-4ddc-99dd-c7069213abfb\") " pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:40.596264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595764 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-cni-bin\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.596264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595792 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef87ff27-5173-4a5f-b14c-036905e7d02b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.596264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595817 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 19:34:40.596264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595833 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-host-var-lib-cni-bin\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.596264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595922 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7fd354ff-50fe-4094-9b62-0d3242209b02-sys-fs\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.596264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.595974 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-node-log\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.596264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.596004 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1fca35f1-b001-4ddc-99dd-c7069213abfb-kubelet-config\") pod \"global-pull-secret-syncer-lrxb5\" (UID: \"1fca35f1-b001-4ddc-99dd-c7069213abfb\") " pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:40.596264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.596048 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7fd354ff-50fe-4094-9b62-0d3242209b02-etc-selinux\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.596264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.596078 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-kubelet\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.596264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.596107 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e507492c-7b39-427a-b189-5317fd33c4f4-tmp-dir\") pod \"node-resolver-krhqb\" (UID: \"e507492c-7b39-427a-b189-5317fd33c4f4\") " pod="openshift-dns/node-resolver-krhqb" Jul 08 19:34:40.597121 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.596169 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee19b31b-83ec-4cfd-9028-53489b1b36e2-serviceca\") pod \"node-ca-qgvpz\" (UID: \"ee19b31b-83ec-4cfd-9028-53489b1b36e2\") " pod="openshift-image-registry/node-ca-qgvpz" Jul 08 19:34:40.597121 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.596194 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-multus-conf-dir\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.597121 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.596222 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7fd354ff-50fe-4094-9b62-0d3242209b02-socket-dir\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.597121 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.596248 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs\") pod \"network-metrics-daemon-4n4kl\" (UID: \"df97169f-20ad-4b99-b6c8-9cec807f0296\") " pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:40.597121 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.596274 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-env-overrides\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.597121 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.596312 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef87ff27-5173-4a5f-b14c-036905e7d02b-system-cni-dir\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.597121 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.596344 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-cni-netd\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.597121 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.596399 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef87ff27-5173-4a5f-b14c-036905e7d02b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.597121 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.596442 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-slash\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.597121 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.596474 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-run-ovn-kubernetes\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.597121 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.596545 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 19:34:40.597121 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.596697 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 19:34:40.597121 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.596737 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8d9w9\"" Jul 08 19:34:40.599679 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.599660 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 19:34:40.622098 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.622074 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dd2vs" Jul 08 19:34:40.630054 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.630036 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dd2vs" Jul 08 19:34:40.685108 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.685075 2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 19:34:40.696744 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.696704 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-cni-bin\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.696907 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.696754 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef87ff27-5173-4a5f-b14c-036905e7d02b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.696907 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.696787 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-host-var-lib-cni-bin\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.696907 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.696818 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09a78f5e-f733-46ee-9a5d-b4088c709163-tmp\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.696907 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.696847 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7fd354ff-50fe-4094-9b62-0d3242209b02-sys-fs\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.696907 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.696871 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-node-log\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.696907 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.696897 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1fca35f1-b001-4ddc-99dd-c7069213abfb-kubelet-config\") pod \"global-pull-secret-syncer-lrxb5\" (UID: \"1fca35f1-b001-4ddc-99dd-c7069213abfb\") " pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:40.697103 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.696868 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-cni-bin\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.697103 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.696925 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-tuned\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.697103 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.696995 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7fd354ff-50fe-4094-9b62-0d3242209b02-etc-selinux\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.697103 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697051 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-node-log\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.697103 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697014 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7fd354ff-50fe-4094-9b62-0d3242209b02-sys-fs\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.697103 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697052 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-kubelet\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.697288 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697107 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-host-var-lib-cni-bin\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.697288 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697102 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-kubelet\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.697288 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697166 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1fca35f1-b001-4ddc-99dd-c7069213abfb-kubelet-config\") pod \"global-pull-secret-syncer-lrxb5\" (UID: \"1fca35f1-b001-4ddc-99dd-c7069213abfb\") " pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:40.697288 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697196 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e507492c-7b39-427a-b189-5317fd33c4f4-tmp-dir\") pod \"node-resolver-krhqb\" (UID: \"e507492c-7b39-427a-b189-5317fd33c4f4\") " pod="openshift-dns/node-resolver-krhqb" Jul 08 19:34:40.697288 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697219 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7fd354ff-50fe-4094-9b62-0d3242209b02-etc-selinux\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.697288 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697235 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee19b31b-83ec-4cfd-9028-53489b1b36e2-serviceca\") pod \"node-ca-qgvpz\" (UID: \"ee19b31b-83ec-4cfd-9028-53489b1b36e2\") " pod="openshift-image-registry/node-ca-qgvpz" Jul 08 19:34:40.697529 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697342 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef87ff27-5173-4a5f-b14c-036905e7d02b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.697529 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697405 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-sysctl-conf\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.697529 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697504 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e507492c-7b39-427a-b189-5317fd33c4f4-tmp-dir\") pod \"node-resolver-krhqb\" (UID: \"e507492c-7b39-427a-b189-5317fd33c4f4\") " pod="openshift-dns/node-resolver-krhqb" Jul 08 19:34:40.697628 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697574 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-multus-conf-dir\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.697628 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697599 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7fd354ff-50fe-4094-9b62-0d3242209b02-socket-dir\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.697708 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697633 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs\") pod \"network-metrics-daemon-4n4kl\" (UID: \"df97169f-20ad-4b99-b6c8-9cec807f0296\") " pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:40.697708 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697648 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-multus-conf-dir\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.697708 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697655 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-env-overrides\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.697708 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697693 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef87ff27-5173-4a5f-b14c-036905e7d02b-system-cni-dir\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.697895 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697720 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee19b31b-83ec-4cfd-9028-53489b1b36e2-serviceca\") pod \"node-ca-qgvpz\" (UID: \"ee19b31b-83ec-4cfd-9028-53489b1b36e2\") " pod="openshift-image-registry/node-ca-qgvpz" Jul 08 19:34:40.697895 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697722 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aef883e7-e871-424e-ac0a-611d758c8ccd-iptables-alerter-script\") pod \"iptables-alerter-m9w7f\" (UID: \"aef883e7-e871-424e-ac0a-611d758c8ccd\") " pod="openshift-network-operator/iptables-alerter-m9w7f" Jul 08 19:34:40.697895 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:40.697757 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:40.697895 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697756 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef87ff27-5173-4a5f-b14c-036905e7d02b-system-cni-dir\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.697895 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697799 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aef883e7-e871-424e-ac0a-611d758c8ccd-host-slash\") pod \"iptables-alerter-m9w7f\" (UID: \"aef883e7-e871-424e-ac0a-611d758c8ccd\") " pod="openshift-network-operator/iptables-alerter-m9w7f" Jul 08 19:34:40.697895 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:40.697828 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs podName:df97169f-20ad-4b99-b6c8-9cec807f0296 nodeName:}" failed. No retries permitted until 2026-07-08 19:34:41.197804599 +0000 UTC m=+2.951448838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs") pod "network-metrics-daemon-4n4kl" (UID: "df97169f-20ad-4b99-b6c8-9cec807f0296") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:40.697895 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697861 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7fd354ff-50fe-4094-9b62-0d3242209b02-socket-dir\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.697895 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697869 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-cni-netd\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.698330 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697911 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-cni-netd\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.698330 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697938 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef87ff27-5173-4a5f-b14c-036905e7d02b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.698330 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697970 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-sysconfig\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.698330 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.697996 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-sys\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.698330 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698023 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-slash\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.698330 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698067 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-run-ovn-kubernetes\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.698330 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698089 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-env-overrides\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.698330 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698100 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-host-var-lib-cni-multus\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.698330 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698093 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-slash\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.698330 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698127 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-run-ovn-kubernetes\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.698330 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698236 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmjg2\" (UniqueName: \"kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2\") pod \"network-check-target-nctzg\" (UID: \"22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d\") " pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:34:40.698330 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698269 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-run\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.698330 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698311 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7fd354ff-50fe-4094-9b62-0d3242209b02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.699039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698338 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-systemd-units\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.699039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698372 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef87ff27-5173-4a5f-b14c-036905e7d02b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.699039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698400 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1fca35f1-b001-4ddc-99dd-c7069213abfb-dbus\") pod \"global-pull-secret-syncer-lrxb5\" (UID: \"1fca35f1-b001-4ddc-99dd-c7069213abfb\") " pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:40.699039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698562 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef87ff27-5173-4a5f-b14c-036905e7d02b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.699039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698430 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-ovnkube-config\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.699039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698635 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef87ff27-5173-4a5f-b14c-036905e7d02b-cnibin\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.699039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698668 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/677911c6-add4-47b7-8d4f-4cac25373bfa-cni-binary-copy\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.699039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698699 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-host-run-netns\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.699039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698149 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-host-var-lib-cni-multus\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.699039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698733 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6d5l\" (UniqueName: \"kubernetes.io/projected/677911c6-add4-47b7-8d4f-4cac25373bfa-kube-api-access-z6d5l\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.699039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698763 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-sysctl-d\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.699039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698803 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-etc-openvswitch\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.699039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698840 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-run-openvswitch\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.699039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698863 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-run-ovn\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.699039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698890 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef87ff27-5173-4a5f-b14c-036905e7d02b-cni-binary-copy\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.699039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698913 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-modprobe-d\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.699039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698936 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-kubernetes\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.699871 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698971 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-var-lib-kubelet\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.699871 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698976 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1fca35f1-b001-4ddc-99dd-c7069213abfb-dbus\") pod \"global-pull-secret-syncer-lrxb5\" (UID: \"1fca35f1-b001-4ddc-99dd-c7069213abfb\") " pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:40.699871 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.698997 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-log-socket\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.699871 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.699043 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7fd354ff-50fe-4094-9b62-0d3242209b02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.699871 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.699048 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-log-socket\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.699871 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.699107 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef87ff27-5173-4a5f-b14c-036905e7d02b-cnibin\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.699871 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.699152 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-run-openvswitch\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.699871 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.699230 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-run-ovn\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.699871 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.699591 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-ovnkube-config\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.699871 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.699657 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-systemd-units\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.699871 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.699781 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/677911c6-add4-47b7-8d4f-4cac25373bfa-cni-binary-copy\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.699871 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.699802 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef87ff27-5173-4a5f-b14c-036905e7d02b-cni-binary-copy\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.699871 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.699815 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef87ff27-5173-4a5f-b14c-036905e7d02b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.699871 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.699859 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-host-run-netns\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.700337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.699895 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-ovn-node-metrics-cert\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.700337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.699889 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-etc-openvswitch\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.700337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.699928 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqrmz\" (UniqueName: \"kubernetes.io/projected/ef87ff27-5173-4a5f-b14c-036905e7d02b-kube-api-access-fqrmz\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.700337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.699959 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-host-run-multus-certs\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.700337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700014 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqsk8\" (UniqueName: \"kubernetes.io/projected/ee19b31b-83ec-4cfd-9028-53489b1b36e2-kube-api-access-rqsk8\") pod \"node-ca-qgvpz\" (UID: \"ee19b31b-83ec-4cfd-9028-53489b1b36e2\") " pod="openshift-image-registry/node-ca-qgvpz" Jul 08 19:34:40.700337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700042 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3adacc1d-0a88-4041-9e23-38c921877431-konnectivity-ca\") pod \"konnectivity-agent-r8d4l\" (UID: \"3adacc1d-0a88-4041-9e23-38c921877431\") " pod="kube-system/konnectivity-agent-r8d4l" Jul 08 19:34:40.700337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700068 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-systemd\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.700337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700091 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-lib-modules\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.700337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700118 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7fd354ff-50fe-4094-9b62-0d3242209b02-device-dir\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.700337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700153 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-run-systemd\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.700337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700179 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-cnibin\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.700337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700203 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-host-var-lib-kubelet\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.700337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700229 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-etc-kubernetes\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.700337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700279 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-etc-kubernetes\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.700337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700277 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjbgk\" (UniqueName: \"kubernetes.io/projected/7fd354ff-50fe-4094-9b62-0d3242209b02-kube-api-access-kjbgk\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.700337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700313 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-cnibin\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.701185 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700432 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-host-var-lib-kubelet\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.701185 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700457 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7fd354ff-50fe-4094-9b62-0d3242209b02-device-dir\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.701185 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700494 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-host-run-multus-certs\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.701185 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700520 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-run-systemd\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.701185 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700501 2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 19:34:40.701185 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700644 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-var-lib-openvswitch\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.701185 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700684 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e507492c-7b39-427a-b189-5317fd33c4f4-hosts-file\") pod \"node-resolver-krhqb\" (UID: \"e507492c-7b39-427a-b189-5317fd33c4f4\") " pod="openshift-dns/node-resolver-krhqb" Jul 08 19:34:40.701185 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700702 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-var-lib-openvswitch\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.701185 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700713 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tjjf\" (UniqueName: \"kubernetes.io/projected/e507492c-7b39-427a-b189-5317fd33c4f4-kube-api-access-7tjjf\") pod \"node-resolver-krhqb\" (UID: \"e507492c-7b39-427a-b189-5317fd33c4f4\") " pod="openshift-dns/node-resolver-krhqb" Jul 08 19:34:40.701185 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700750 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-os-release\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.701185 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700765 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e507492c-7b39-427a-b189-5317fd33c4f4-hosts-file\") pod \"node-resolver-krhqb\" (UID: \"e507492c-7b39-427a-b189-5317fd33c4f4\") " pod="openshift-dns/node-resolver-krhqb" Jul 08 19:34:40.701185 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700795 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-host-run-k8s-cni-cncf-io\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.701185 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700844 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-os-release\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.701185 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700829 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhg9g\" (UniqueName: \"kubernetes.io/projected/aef883e7-e871-424e-ac0a-611d758c8ccd-kube-api-access-jhg9g\") pod \"iptables-alerter-m9w7f\" (UID: \"aef883e7-e871-424e-ac0a-611d758c8ccd\") " pod="openshift-network-operator/iptables-alerter-m9w7f" Jul 08 19:34:40.701185 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700888 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef87ff27-5173-4a5f-b14c-036905e7d02b-os-release\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.701185 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700914 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-multus-cni-dir\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.701185 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700891 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-host-run-k8s-cni-cncf-io\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.701185 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.700933 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-multus-socket-dir-parent\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.702181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701018 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-multus-socket-dir-parent\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.702181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701053 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee19b31b-83ec-4cfd-9028-53489b1b36e2-host\") pod \"node-ca-qgvpz\" (UID: \"ee19b31b-83ec-4cfd-9028-53489b1b36e2\") " pod="openshift-image-registry/node-ca-qgvpz" Jul 08 19:34:40.702181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701066 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-multus-cni-dir\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.702181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701079 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-host\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.702181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701084 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef87ff27-5173-4a5f-b14c-036905e7d02b-os-release\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.702181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701112 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4trnl\" (UniqueName: \"kubernetes.io/projected/df97169f-20ad-4b99-b6c8-9cec807f0296-kube-api-access-4trnl\") pod \"network-metrics-daemon-4n4kl\" (UID: \"df97169f-20ad-4b99-b6c8-9cec807f0296\") " pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:40.702181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701138 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee19b31b-83ec-4cfd-9028-53489b1b36e2-host\") pod \"node-ca-qgvpz\" (UID: \"ee19b31b-83ec-4cfd-9028-53489b1b36e2\") " pod="openshift-image-registry/node-ca-qgvpz" Jul 08 19:34:40.702181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701172 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzxrb\" (UniqueName: \"kubernetes.io/projected/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-kube-api-access-jzxrb\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.702181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701221 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7fd354ff-50fe-4094-9b62-0d3242209b02-registration-dir\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.702181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701358 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.702181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701363 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7fd354ff-50fe-4094-9b62-0d3242209b02-registration-dir\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.702181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701408 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-ovnkube-script-lib\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.702181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701420 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.702181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701437 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-system-cni-dir\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.702181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701496 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-hostroot\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.702181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701552 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3adacc1d-0a88-4041-9e23-38c921877431-agent-certs\") pod \"konnectivity-agent-r8d4l\" (UID: \"3adacc1d-0a88-4041-9e23-38c921877431\") " pod="kube-system/konnectivity-agent-r8d4l" Jul 08 19:34:40.702181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701572 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-system-cni-dir\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.703070 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701594 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgn9b\" (UniqueName: \"kubernetes.io/projected/09a78f5e-f733-46ee-9a5d-b4088c709163-kube-api-access-jgn9b\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.703070 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701613 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/677911c6-add4-47b7-8d4f-4cac25373bfa-hostroot\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.703070 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701652 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-run-netns\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.703070 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701693 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-host-run-netns\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.703070 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701696 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/677911c6-add4-47b7-8d4f-4cac25373bfa-multus-daemon-config\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.703070 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701740 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret\") pod \"global-pull-secret-syncer-lrxb5\" (UID: \"1fca35f1-b001-4ddc-99dd-c7069213abfb\") " pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:40.703070 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:40.701893 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:40.703070 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.701942 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-ovnkube-script-lib\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.703070 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:40.701958 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret podName:1fca35f1-b001-4ddc-99dd-c7069213abfb nodeName:}" failed. No retries permitted until 2026-07-08 19:34:41.201940121 +0000 UTC m=+2.955584346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret") pod "global-pull-secret-syncer-lrxb5" (UID: "1fca35f1-b001-4ddc-99dd-c7069213abfb") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:40.703070 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.702168 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/677911c6-add4-47b7-8d4f-4cac25373bfa-multus-daemon-config\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.705001 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.704978 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-ovn-node-metrics-cert\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.710836 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:40.706858 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:34:40.710836 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:40.706885 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:34:40.710836 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:40.706900 2553 projected.go:196] Error preparing data for projected volume kube-api-access-cmjg2 for pod openshift-network-diagnostics/network-check-target-nctzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:40.710836 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:40.706969 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2 podName:22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d nodeName:}" failed. No retries permitted until 2026-07-08 19:34:41.206951891 +0000 UTC m=+2.960596126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cmjg2" (UniqueName: "kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2") pod "network-check-target-nctzg" (UID: "22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:40.710836 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.710277 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6d5l\" (UniqueName: \"kubernetes.io/projected/677911c6-add4-47b7-8d4f-4cac25373bfa-kube-api-access-z6d5l\") pod \"multus-j2mdw\" (UID: \"677911c6-add4-47b7-8d4f-4cac25373bfa\") " pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.715335 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.715305 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4trnl\" (UniqueName: \"kubernetes.io/projected/df97169f-20ad-4b99-b6c8-9cec807f0296-kube-api-access-4trnl\") pod \"network-metrics-daemon-4n4kl\" (UID: \"df97169f-20ad-4b99-b6c8-9cec807f0296\") " pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:40.716224 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.716200 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqsk8\" (UniqueName: \"kubernetes.io/projected/ee19b31b-83ec-4cfd-9028-53489b1b36e2-kube-api-access-rqsk8\") pod \"node-ca-qgvpz\" (UID: \"ee19b31b-83ec-4cfd-9028-53489b1b36e2\") " pod="openshift-image-registry/node-ca-qgvpz" Jul 08 19:34:40.717356 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.717328 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjbgk\" (UniqueName: \"kubernetes.io/projected/7fd354ff-50fe-4094-9b62-0d3242209b02-kube-api-access-kjbgk\") pod \"aws-ebs-csi-driver-node-t64gk\" (UID: \"7fd354ff-50fe-4094-9b62-0d3242209b02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.717708 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.717683 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqrmz\" (UniqueName: \"kubernetes.io/projected/ef87ff27-5173-4a5f-b14c-036905e7d02b-kube-api-access-fqrmz\") pod \"multus-additional-cni-plugins-grmlv\" (UID: \"ef87ff27-5173-4a5f-b14c-036905e7d02b\") " pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.718309 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.718276 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tjjf\" (UniqueName: \"kubernetes.io/projected/e507492c-7b39-427a-b189-5317fd33c4f4-kube-api-access-7tjjf\") pod \"node-resolver-krhqb\" (UID: \"e507492c-7b39-427a-b189-5317fd33c4f4\") " pod="openshift-dns/node-resolver-krhqb" Jul 08 19:34:40.720118 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.720088 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzxrb\" (UniqueName: \"kubernetes.io/projected/a2e57f9a-ec19-418b-bb13-f72ac6c49be0-kube-api-access-jzxrb\") pod \"ovnkube-node-c9rnh\" (UID: \"a2e57f9a-ec19-418b-bb13-f72ac6c49be0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.777960 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.777919 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal" event={"ID":"305d9cf3b9e0fa073efd5151ba0d6bd1","Type":"ContainerStarted","Data":"538b30f74bd494ac9c78b911fb693b52ff9c232d465f8caea0dce09045958e37"} Jul 08 19:34:40.802738 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.802702 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-sysctl-d\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.802922 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.802750 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-modprobe-d\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.802922 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.802778 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-kubernetes\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.802922 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.802802 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-var-lib-kubelet\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.802922 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.802832 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3adacc1d-0a88-4041-9e23-38c921877431-konnectivity-ca\") pod \"konnectivity-agent-r8d4l\" (UID: \"3adacc1d-0a88-4041-9e23-38c921877431\") " pod="kube-system/konnectivity-agent-r8d4l" Jul 08 19:34:40.802922 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.802882 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-systemd\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.802922 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.802907 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-lib-modules\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.802945 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhg9g\" (UniqueName: \"kubernetes.io/projected/aef883e7-e871-424e-ac0a-611d758c8ccd-kube-api-access-jhg9g\") pod \"iptables-alerter-m9w7f\" (UID: \"aef883e7-e871-424e-ac0a-611d758c8ccd\") " pod="openshift-network-operator/iptables-alerter-m9w7f" Jul 08 19:34:40.803242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.802976 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-host\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.802993 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-var-lib-kubelet\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803014 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-modprobe-d\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803024 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-kubernetes\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803039 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3adacc1d-0a88-4041-9e23-38c921877431-agent-certs\") pod \"konnectivity-agent-r8d4l\" (UID: \"3adacc1d-0a88-4041-9e23-38c921877431\") " pod="kube-system/konnectivity-agent-r8d4l" Jul 08 19:34:40.803242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803080 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgn9b\" (UniqueName: \"kubernetes.io/projected/09a78f5e-f733-46ee-9a5d-b4088c709163-kube-api-access-jgn9b\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803135 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09a78f5e-f733-46ee-9a5d-b4088c709163-tmp\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803123 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-systemd\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803169 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-tuned\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803194 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-host\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803200 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-sysctl-conf\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803938 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803253 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aef883e7-e871-424e-ac0a-611d758c8ccd-iptables-alerter-script\") pod \"iptables-alerter-m9w7f\" (UID: \"aef883e7-e871-424e-ac0a-611d758c8ccd\") " pod="openshift-network-operator/iptables-alerter-m9w7f" Jul 08 19:34:40.803938 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803265 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-lib-modules\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803938 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803282 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aef883e7-e871-424e-ac0a-611d758c8ccd-host-slash\") pod \"iptables-alerter-m9w7f\" (UID: \"aef883e7-e871-424e-ac0a-611d758c8ccd\") " pod="openshift-network-operator/iptables-alerter-m9w7f" Jul 08 19:34:40.803938 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803313 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-sysconfig\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803938 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803339 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-sys\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803938 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803380 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-run\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803938 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803461 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-run\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803938 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803619 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-sysctl-conf\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803938 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803194 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-sysctl-d\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803938 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803736 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-sysconfig\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.803938 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803755 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3adacc1d-0a88-4041-9e23-38c921877431-konnectivity-ca\") pod \"konnectivity-agent-r8d4l\" (UID: \"3adacc1d-0a88-4041-9e23-38c921877431\") " pod="kube-system/konnectivity-agent-r8d4l" Jul 08 19:34:40.803938 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803791 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aef883e7-e871-424e-ac0a-611d758c8ccd-host-slash\") pod \"iptables-alerter-m9w7f\" (UID: \"aef883e7-e871-424e-ac0a-611d758c8ccd\") " pod="openshift-network-operator/iptables-alerter-m9w7f" Jul 08 19:34:40.803938 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.803846 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09a78f5e-f733-46ee-9a5d-b4088c709163-sys\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.804656 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.804233 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aef883e7-e871-424e-ac0a-611d758c8ccd-iptables-alerter-script\") pod \"iptables-alerter-m9w7f\" (UID: \"aef883e7-e871-424e-ac0a-611d758c8ccd\") " pod="openshift-network-operator/iptables-alerter-m9w7f" Jul 08 19:34:40.806103 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.806073 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/09a78f5e-f733-46ee-9a5d-b4088c709163-etc-tuned\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.806540 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.806478 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3adacc1d-0a88-4041-9e23-38c921877431-agent-certs\") pod \"konnectivity-agent-r8d4l\" (UID: \"3adacc1d-0a88-4041-9e23-38c921877431\") " pod="kube-system/konnectivity-agent-r8d4l" Jul 08 19:34:40.807196 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.807174 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09a78f5e-f733-46ee-9a5d-b4088c709163-tmp\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.815989 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.815932 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgn9b\" (UniqueName: \"kubernetes.io/projected/09a78f5e-f733-46ee-9a5d-b4088c709163-kube-api-access-jgn9b\") pod \"tuned-7g4xw\" (UID: \"09a78f5e-f733-46ee-9a5d-b4088c709163\") " pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.816635 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.816611 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhg9g\" (UniqueName: \"kubernetes.io/projected/aef883e7-e871-424e-ac0a-611d758c8ccd-kube-api-access-jhg9g\") pod \"iptables-alerter-m9w7f\" (UID: \"aef883e7-e871-424e-ac0a-611d758c8ccd\") " pod="openshift-network-operator/iptables-alerter-m9w7f" Jul 08 19:34:40.827758 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.827731 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:34:40.885020 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.884987 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j2mdw" Jul 08 19:34:40.894364 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.894341 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" Jul 08 19:34:40.895271 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:40.895241 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod677911c6_add4_47b7_8d4f_4cac25373bfa.slice/crio-40b75e2e02092c5dc44fc28a7297dec99b53589f9c59c6697fe0bcd6a50a3158 WatchSource:0}: Error finding container 40b75e2e02092c5dc44fc28a7297dec99b53589f9c59c6697fe0bcd6a50a3158: Status 404 returned error can't find the container with id 40b75e2e02092c5dc44fc28a7297dec99b53589f9c59c6697fe0bcd6a50a3158 Jul 08 19:34:40.902653 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.902630 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:34:40.904142 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:40.904116 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fd354ff_50fe_4094_9b62_0d3242209b02.slice/crio-26f6d322ea6f48057af84e47331a858b3dab9c3f907c7fd4cfb64310bb1903e9 WatchSource:0}: Error finding container 26f6d322ea6f48057af84e47331a858b3dab9c3f907c7fd4cfb64310bb1903e9: Status 404 returned error can't find the container with id 26f6d322ea6f48057af84e47331a858b3dab9c3f907c7fd4cfb64310bb1903e9 Jul 08 19:34:40.907226 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.907157 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-krhqb" Jul 08 19:34:40.914031 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.914007 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qgvpz" Jul 08 19:34:40.914308 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:40.914267 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e57f9a_ec19_418b_bb13_f72ac6c49be0.slice/crio-c6659b8dd2d17587820c2998c84f273ef3cae9a01c7ece869623f522969a3177 WatchSource:0}: Error finding container c6659b8dd2d17587820c2998c84f273ef3cae9a01c7ece869623f522969a3177: Status 404 returned error can't find the container with id c6659b8dd2d17587820c2998c84f273ef3cae9a01c7ece869623f522969a3177 Jul 08 19:34:40.918189 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:40.918165 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode507492c_7b39_427a_b189_5317fd33c4f4.slice/crio-1b5d3322e0bd18e6a167e2f95f4ee267e9275402282d6951027a23f736b2b91a WatchSource:0}: Error finding container 1b5d3322e0bd18e6a167e2f95f4ee267e9275402282d6951027a23f736b2b91a: Status 404 returned error can't find the container with id 1b5d3322e0bd18e6a167e2f95f4ee267e9275402282d6951027a23f736b2b91a Jul 08 19:34:40.920646 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.920625 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-grmlv" Jul 08 19:34:40.924320 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:40.924298 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee19b31b_83ec_4cfd_9028_53489b1b36e2.slice/crio-b3cccec398a79b964b609d8bc7d0559f330025ce704b033019273faf8039ffb3 WatchSource:0}: Error finding container b3cccec398a79b964b609d8bc7d0559f330025ce704b033019273faf8039ffb3: Status 404 returned error can't find the container with id b3cccec398a79b964b609d8bc7d0559f330025ce704b033019273faf8039ffb3 Jul 08 19:34:40.927336 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.927251 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" Jul 08 19:34:40.929691 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:40.929667 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef87ff27_5173_4a5f_b14c_036905e7d02b.slice/crio-72e5f14c358e3095b35f2e0b47e2491480d17faeb65177e3522c1dd653188180 WatchSource:0}: Error finding container 72e5f14c358e3095b35f2e0b47e2491480d17faeb65177e3522c1dd653188180: Status 404 returned error can't find the container with id 72e5f14c358e3095b35f2e0b47e2491480d17faeb65177e3522c1dd653188180 Jul 08 19:34:40.933318 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.933299 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m9w7f" Jul 08 19:34:40.938213 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:40.938194 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r8d4l" Jul 08 19:34:41.206385 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:41.206294 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret\") pod \"global-pull-secret-syncer-lrxb5\" (UID: \"1fca35f1-b001-4ddc-99dd-c7069213abfb\") " pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:41.206385 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:41.206349 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs\") pod \"network-metrics-daemon-4n4kl\" (UID: \"df97169f-20ad-4b99-b6c8-9cec807f0296\") " pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:41.206625 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:41.206486 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:41.206625 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:41.206562 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret podName:1fca35f1-b001-4ddc-99dd-c7069213abfb nodeName:}" failed. No retries permitted until 2026-07-08 19:34:42.206541427 +0000 UTC m=+3.960185673 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret") pod "global-pull-secret-syncer-lrxb5" (UID: "1fca35f1-b001-4ddc-99dd-c7069213abfb") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:41.206625 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:41.206490 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:41.206758 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:41.206638 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs podName:df97169f-20ad-4b99-b6c8-9cec807f0296 nodeName:}" failed. No retries permitted until 2026-07-08 19:34:42.206622962 +0000 UTC m=+3.960267185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs") pod "network-metrics-daemon-4n4kl" (UID: "df97169f-20ad-4b99-b6c8-9cec807f0296") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:41.306753 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:41.306717 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmjg2\" (UniqueName: \"kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2\") pod \"network-check-target-nctzg\" (UID: \"22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d\") " pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:34:41.306951 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:41.306902 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:34:41.306951 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:41.306928 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:34:41.306951 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:41.306942 2553 projected.go:196] Error preparing data for projected volume kube-api-access-cmjg2 for pod openshift-network-diagnostics/network-check-target-nctzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:41.307135 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:41.307014 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2 podName:22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d nodeName:}" failed. No retries permitted until 2026-07-08 19:34:42.306992201 +0000 UTC m=+4.060636440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cmjg2" (UniqueName: "kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2") pod "network-check-target-nctzg" (UID: "22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:41.632485 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:41.632281 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 19:29:40 +0000 UTC" deadline="2028-01-16 01:28:36.925760804 +0000 UTC" Jul 08 19:34:41.632485 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:41.632351 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13349h53m55.293419777s" Jul 08 19:34:41.772590 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:41.772554 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:41.772760 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:41.772703 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:34:41.772760 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:41.772724 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:41.772879 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:41.772804 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrxb5" podUID="1fca35f1-b001-4ddc-99dd-c7069213abfb" Jul 08 19:34:41.781064 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:41.781024 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grmlv" event={"ID":"ef87ff27-5173-4a5f-b14c-036905e7d02b","Type":"ContainerStarted","Data":"72e5f14c358e3095b35f2e0b47e2491480d17faeb65177e3522c1dd653188180"} Jul 08 19:34:41.782313 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:41.782281 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qgvpz" event={"ID":"ee19b31b-83ec-4cfd-9028-53489b1b36e2","Type":"ContainerStarted","Data":"b3cccec398a79b964b609d8bc7d0559f330025ce704b033019273faf8039ffb3"} Jul 08 19:34:41.783575 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:41.783548 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-krhqb" event={"ID":"e507492c-7b39-427a-b189-5317fd33c4f4","Type":"ContainerStarted","Data":"1b5d3322e0bd18e6a167e2f95f4ee267e9275402282d6951027a23f736b2b91a"} Jul 08 19:34:41.784969 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:41.784947 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" event={"ID":"a2e57f9a-ec19-418b-bb13-f72ac6c49be0","Type":"ContainerStarted","Data":"c6659b8dd2d17587820c2998c84f273ef3cae9a01c7ece869623f522969a3177"} Jul 08 19:34:41.786222 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:41.786195 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" event={"ID":"7fd354ff-50fe-4094-9b62-0d3242209b02","Type":"ContainerStarted","Data":"26f6d322ea6f48057af84e47331a858b3dab9c3f907c7fd4cfb64310bb1903e9"} Jul 08 19:34:41.787474 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:41.787454 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j2mdw" event={"ID":"677911c6-add4-47b7-8d4f-4cac25373bfa","Type":"ContainerStarted","Data":"40b75e2e02092c5dc44fc28a7297dec99b53589f9c59c6697fe0bcd6a50a3158"} Jul 08 19:34:42.101808 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:42.101769 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09a78f5e_f733_46ee_9a5d_b4088c709163.slice/crio-46d796ad9fa82cf9063d8f2c9bd6fb4ce4db4d1bba58acd51bd31fd9784f15e9 WatchSource:0}: Error finding container 46d796ad9fa82cf9063d8f2c9bd6fb4ce4db4d1bba58acd51bd31fd9784f15e9: Status 404 returned error can't find the container with id 46d796ad9fa82cf9063d8f2c9bd6fb4ce4db4d1bba58acd51bd31fd9784f15e9 Jul 08 19:34:42.135740 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:42.135689 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaef883e7_e871_424e_ac0a_611d758c8ccd.slice/crio-8958c4ead2eef5770e21b716dae389eb687143fad74637360d8b817dc0ed36f0 WatchSource:0}: Error finding container 8958c4ead2eef5770e21b716dae389eb687143fad74637360d8b817dc0ed36f0: Status 404 returned error can't find the container with id 8958c4ead2eef5770e21b716dae389eb687143fad74637360d8b817dc0ed36f0 Jul 08 19:34:42.137546 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:34:42.137368 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3adacc1d_0a88_4041_9e23_38c921877431.slice/crio-079ad1220cf94dac55db2d72a425a523e5187af57db3efaf0d4b43a81590413a WatchSource:0}: Error finding container 079ad1220cf94dac55db2d72a425a523e5187af57db3efaf0d4b43a81590413a: Status 404 returned error can't find the container with id 079ad1220cf94dac55db2d72a425a523e5187af57db3efaf0d4b43a81590413a Jul 08 19:34:42.214818 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:42.214640 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret\") pod \"global-pull-secret-syncer-lrxb5\" (UID: \"1fca35f1-b001-4ddc-99dd-c7069213abfb\") " pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:42.214930 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:42.214859 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs\") pod \"network-metrics-daemon-4n4kl\" (UID: \"df97169f-20ad-4b99-b6c8-9cec807f0296\") " pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:42.215050 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:42.215026 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:42.215157 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:42.215098 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs podName:df97169f-20ad-4b99-b6c8-9cec807f0296 nodeName:}" failed. No retries permitted until 2026-07-08 19:34:44.215077873 +0000 UTC m=+5.968722096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs") pod "network-metrics-daemon-4n4kl" (UID: "df97169f-20ad-4b99-b6c8-9cec807f0296") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:42.215229 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:42.215169 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:42.215229 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:42.215201 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret podName:1fca35f1-b001-4ddc-99dd-c7069213abfb nodeName:}" failed. No retries permitted until 2026-07-08 19:34:44.215192873 +0000 UTC m=+5.968837094 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret") pod "global-pull-secret-syncer-lrxb5" (UID: "1fca35f1-b001-4ddc-99dd-c7069213abfb") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:42.315837 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:42.315801 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmjg2\" (UniqueName: \"kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2\") pod \"network-check-target-nctzg\" (UID: \"22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d\") " pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:34:42.316063 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:42.316044 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:34:42.316116 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:42.316077 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:34:42.316116 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:42.316091 2553 projected.go:196] Error preparing data for projected volume kube-api-access-cmjg2 for pod openshift-network-diagnostics/network-check-target-nctzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:42.316199 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:42.316150 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2 podName:22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d nodeName:}" failed. No retries permitted until 2026-07-08 19:34:44.316130804 +0000 UTC m=+6.069775026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cmjg2" (UniqueName: "kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2") pod "network-check-target-nctzg" (UID: "22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:42.633604 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:42.633498 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 19:29:40 +0000 UTC" deadline="2028-03-29 01:47:44.976824826 +0000 UTC" Jul 08 19:34:42.633604 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:42.633544 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15102h13m2.34328612s" Jul 08 19:34:42.773825 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:42.773551 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:34:42.773825 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:42.773694 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nctzg" podUID="22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d" Jul 08 19:34:42.801237 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:42.801140 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" event={"ID":"09a78f5e-f733-46ee-9a5d-b4088c709163","Type":"ContainerStarted","Data":"46d796ad9fa82cf9063d8f2c9bd6fb4ce4db4d1bba58acd51bd31fd9784f15e9"} Jul 08 19:34:42.810302 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:42.808591 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r8d4l" event={"ID":"3adacc1d-0a88-4041-9e23-38c921877431","Type":"ContainerStarted","Data":"079ad1220cf94dac55db2d72a425a523e5187af57db3efaf0d4b43a81590413a"} Jul 08 19:34:42.817310 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:42.817278 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-108.ec2.internal" event={"ID":"b7ec4acbf852e2b07ece08ecc1022c7c","Type":"ContainerStarted","Data":"4404947d60ceb5a4932afde736391434dfa6e039acedaf677830008d7f0cf305"} Jul 08 19:34:42.825830 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:42.825801 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m9w7f" event={"ID":"aef883e7-e871-424e-ac0a-611d758c8ccd","Type":"ContainerStarted","Data":"8958c4ead2eef5770e21b716dae389eb687143fad74637360d8b817dc0ed36f0"} Jul 08 19:34:43.772437 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:43.772398 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:43.772946 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:43.772571 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrxb5" podUID="1fca35f1-b001-4ddc-99dd-c7069213abfb" Jul 08 19:34:43.773012 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:43.772995 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:43.773146 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:43.773119 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:34:43.834557 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:43.834496 2553 generic.go:356] "Generic (PLEG): container finished" podID="305d9cf3b9e0fa073efd5151ba0d6bd1" containerID="3166113d0206b10db4419ce85b4a78b46791403f54aa6f358273c664b2eaf9ab" exitCode=0 Jul 08 19:34:43.835090 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:43.835065 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal" event={"ID":"305d9cf3b9e0fa073efd5151ba0d6bd1","Type":"ContainerDied","Data":"3166113d0206b10db4419ce85b4a78b46791403f54aa6f358273c664b2eaf9ab"} Jul 08 19:34:43.894601 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:43.894538 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-108.ec2.internal" podStartSLOduration=3.894515533 podStartE2EDuration="3.894515533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:34:42.833544528 +0000 UTC m=+4.587188773" watchObservedRunningTime="2026-07-08 19:34:43.894515533 +0000 UTC m=+5.648159778" Jul 08 19:34:44.237488 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:44.236770 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret\") pod \"global-pull-secret-syncer-lrxb5\" (UID: \"1fca35f1-b001-4ddc-99dd-c7069213abfb\") " pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:44.237488 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:44.236828 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs\") pod \"network-metrics-daemon-4n4kl\" (UID: \"df97169f-20ad-4b99-b6c8-9cec807f0296\") " pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:44.237488 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:44.236962 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:44.237488 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:44.237021 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs podName:df97169f-20ad-4b99-b6c8-9cec807f0296 nodeName:}" failed. No retries permitted until 2026-07-08 19:34:48.237001778 +0000 UTC m=+9.990646004 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs") pod "network-metrics-daemon-4n4kl" (UID: "df97169f-20ad-4b99-b6c8-9cec807f0296") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:44.237488 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:44.237405 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:44.237488 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:44.237454 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret podName:1fca35f1-b001-4ddc-99dd-c7069213abfb nodeName:}" failed. No retries permitted until 2026-07-08 19:34:48.237438519 +0000 UTC m=+9.991082743 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret") pod "global-pull-secret-syncer-lrxb5" (UID: "1fca35f1-b001-4ddc-99dd-c7069213abfb") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:44.337834 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:44.337751 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmjg2\" (UniqueName: \"kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2\") pod \"network-check-target-nctzg\" (UID: \"22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d\") " pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:34:44.338031 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:44.337988 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:34:44.338031 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:44.338011 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:34:44.338031 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:44.338025 2553 projected.go:196] Error preparing data for projected volume kube-api-access-cmjg2 for pod openshift-network-diagnostics/network-check-target-nctzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:44.338223 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:44.338082 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2 podName:22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d nodeName:}" failed. No retries permitted until 2026-07-08 19:34:48.338061864 +0000 UTC m=+10.091706090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cmjg2" (UniqueName: "kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2") pod "network-check-target-nctzg" (UID: "22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:44.776059 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:44.775536 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:34:44.776059 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:44.775661 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nctzg" podUID="22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d" Jul 08 19:34:44.845656 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:44.845588 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal" event={"ID":"305d9cf3b9e0fa073efd5151ba0d6bd1","Type":"ContainerStarted","Data":"ccf9827cef147f3e0cb493e3e4689cf168a46b1c5f6c7c9c98c0f2ae16059c99"} Jul 08 19:34:44.866300 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:44.866239 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-108.ec2.internal" podStartSLOduration=4.866219803 podStartE2EDuration="4.866219803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:34:44.86587555 +0000 UTC m=+6.619519834" watchObservedRunningTime="2026-07-08 19:34:44.866219803 +0000 UTC m=+6.619864050" Jul 08 19:34:45.773069 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:45.772600 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:45.773069 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:45.772728 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:34:45.773069 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:45.772948 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:45.773358 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:45.773085 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrxb5" podUID="1fca35f1-b001-4ddc-99dd-c7069213abfb" Jul 08 19:34:46.772766 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:46.772240 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:34:46.772766 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:46.772391 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nctzg" podUID="22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d" Jul 08 19:34:47.772186 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:47.772133 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:47.772186 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:47.772180 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:47.772450 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:47.772270 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:34:47.772687 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:47.772657 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrxb5" podUID="1fca35f1-b001-4ddc-99dd-c7069213abfb" Jul 08 19:34:48.272042 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:48.271717 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret\") pod \"global-pull-secret-syncer-lrxb5\" (UID: \"1fca35f1-b001-4ddc-99dd-c7069213abfb\") " pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:48.272042 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:48.271782 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs\") pod \"network-metrics-daemon-4n4kl\" (UID: \"df97169f-20ad-4b99-b6c8-9cec807f0296\") " pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:48.272042 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:48.271953 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:48.272042 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:48.271987 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:48.272042 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:48.272019 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs podName:df97169f-20ad-4b99-b6c8-9cec807f0296 nodeName:}" failed. No retries permitted until 2026-07-08 19:34:56.271998852 +0000 UTC m=+18.025643091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs") pod "network-metrics-daemon-4n4kl" (UID: "df97169f-20ad-4b99-b6c8-9cec807f0296") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:48.272042 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:48.272038 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret podName:1fca35f1-b001-4ddc-99dd-c7069213abfb nodeName:}" failed. No retries permitted until 2026-07-08 19:34:56.272028712 +0000 UTC m=+18.025672932 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret") pod "global-pull-secret-syncer-lrxb5" (UID: "1fca35f1-b001-4ddc-99dd-c7069213abfb") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:48.372213 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:48.372173 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmjg2\" (UniqueName: \"kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2\") pod \"network-check-target-nctzg\" (UID: \"22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d\") " pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:34:48.372384 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:48.372344 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:34:48.372384 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:48.372365 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:34:48.372384 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:48.372377 2553 projected.go:196] Error preparing data for projected volume kube-api-access-cmjg2 for pod openshift-network-diagnostics/network-check-target-nctzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:48.372572 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:48.372454 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2 podName:22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d nodeName:}" failed. No retries permitted until 2026-07-08 19:34:56.372419498 +0000 UTC m=+18.126063741 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cmjg2" (UniqueName: "kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2") pod "network-check-target-nctzg" (UID: "22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:48.773827 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:48.773368 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:34:48.773827 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:48.773488 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nctzg" podUID="22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d" Jul 08 19:34:49.773128 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:49.773045 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:49.773589 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:49.773186 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:34:49.773589 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:49.773341 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:49.773589 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:49.773510 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrxb5" podUID="1fca35f1-b001-4ddc-99dd-c7069213abfb" Jul 08 19:34:50.773015 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:50.772983 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:34:50.773188 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:50.773099 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nctzg" podUID="22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d" Jul 08 19:34:51.772641 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:51.772599 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:51.772817 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:51.772739 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:34:51.773158 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:51.773135 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:51.773283 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:51.773231 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrxb5" podUID="1fca35f1-b001-4ddc-99dd-c7069213abfb" Jul 08 19:34:52.772501 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:52.772463 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:34:52.772650 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:52.772588 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nctzg" podUID="22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d" Jul 08 19:34:53.772847 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:53.772808 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:53.773304 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:53.772946 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrxb5" podUID="1fca35f1-b001-4ddc-99dd-c7069213abfb" Jul 08 19:34:53.773304 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:53.773014 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:53.773304 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:53.773176 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:34:54.773112 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:54.773075 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:34:54.773563 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:54.773189 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nctzg" podUID="22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d" Jul 08 19:34:55.772658 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:55.772623 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:55.772907 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:55.772744 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:34:55.772907 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:55.772806 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:55.773022 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:55.772927 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrxb5" podUID="1fca35f1-b001-4ddc-99dd-c7069213abfb" Jul 08 19:34:56.331243 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:56.331209 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs\") pod \"network-metrics-daemon-4n4kl\" (UID: \"df97169f-20ad-4b99-b6c8-9cec807f0296\") " pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:56.331705 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:56.331287 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret\") pod \"global-pull-secret-syncer-lrxb5\" (UID: \"1fca35f1-b001-4ddc-99dd-c7069213abfb\") " pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:56.331705 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:56.331373 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:56.331705 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:56.331425 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret podName:1fca35f1-b001-4ddc-99dd-c7069213abfb nodeName:}" failed. No retries permitted until 2026-07-08 19:35:12.331411401 +0000 UTC m=+34.085055619 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret") pod "global-pull-secret-syncer-lrxb5" (UID: "1fca35f1-b001-4ddc-99dd-c7069213abfb") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:34:56.331705 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:56.331373 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:56.331705 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:56.331507 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs podName:df97169f-20ad-4b99-b6c8-9cec807f0296 nodeName:}" failed. No retries permitted until 2026-07-08 19:35:12.331493982 +0000 UTC m=+34.085138215 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs") pod "network-metrics-daemon-4n4kl" (UID: "df97169f-20ad-4b99-b6c8-9cec807f0296") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:34:56.431839 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:56.431800 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmjg2\" (UniqueName: \"kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2\") pod \"network-check-target-nctzg\" (UID: \"22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d\") " pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:34:56.432010 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:56.431967 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:34:56.432010 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:56.431989 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:34:56.432010 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:56.431999 2553 projected.go:196] Error preparing data for projected volume kube-api-access-cmjg2 for pod openshift-network-diagnostics/network-check-target-nctzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:56.432186 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:56.432053 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2 podName:22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d nodeName:}" failed. No retries permitted until 2026-07-08 19:35:12.432036721 +0000 UTC m=+34.185680940 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cmjg2" (UniqueName: "kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2") pod "network-check-target-nctzg" (UID: "22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:34:56.772183 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:56.772106 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:34:56.772314 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:56.772238 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nctzg" podUID="22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d" Jul 08 19:34:57.772540 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:57.772505 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:57.772919 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:57.772509 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:57.772919 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:57.772658 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:34:57.772919 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:57.772686 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrxb5" podUID="1fca35f1-b001-4ddc-99dd-c7069213abfb" Jul 08 19:34:58.774024 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:58.773989 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:34:58.774462 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:58.774108 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nctzg" podUID="22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d" Jul 08 19:34:59.772175 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:59.772135 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:34:59.772366 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:34:59.772178 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:34:59.772366 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:59.772274 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:34:59.772510 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:34:59.772393 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrxb5" podUID="1fca35f1-b001-4ddc-99dd-c7069213abfb" Jul 08 19:35:00.772666 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:00.772349 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:35:00.773472 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:00.772767 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nctzg" podUID="22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d" Jul 08 19:35:00.876870 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:00.876846 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-krhqb" event={"ID":"e507492c-7b39-427a-b189-5317fd33c4f4","Type":"ContainerStarted","Data":"413b181420ccbb46411d97ab52c4be1e1e024380e5147a6e51e096a3d5f9fa4c"} Jul 08 19:35:00.879380 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:00.879356 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" event={"ID":"a2e57f9a-ec19-418b-bb13-f72ac6c49be0","Type":"ContainerStarted","Data":"6f2eb45afc90a1b270872cbfa9aa0a0f862770b39384208eb4ec07891ecb3978"} Jul 08 19:35:00.879506 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:00.879461 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" event={"ID":"a2e57f9a-ec19-418b-bb13-f72ac6c49be0","Type":"ContainerStarted","Data":"5476a53c7babf31fe77c8b09cb90fdc98fc3ff1eb968849417b2fbb5c0f57b69"} Jul 08 19:35:00.879576 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:00.879516 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" event={"ID":"a2e57f9a-ec19-418b-bb13-f72ac6c49be0","Type":"ContainerStarted","Data":"611045c8f0a82630ffb4bc4ecd866a68325da6723e250b59b18a4b64f5470d9e"} Jul 08 19:35:00.879576 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:00.879567 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" event={"ID":"a2e57f9a-ec19-418b-bb13-f72ac6c49be0","Type":"ContainerStarted","Data":"a6f7d7ffe21db0378f3fe03d4e7d398a1ef1df881f6b859428f9172d963368c9"} Jul 08 19:35:00.885007 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:00.884980 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j2mdw" event={"ID":"677911c6-add4-47b7-8d4f-4cac25373bfa","Type":"ContainerStarted","Data":"3b40b99a672fc7942cc70c219f1a390202a494701b4ffbbb7f58057b653b66c8"} Jul 08 19:35:00.887205 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:00.887178 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r8d4l" event={"ID":"3adacc1d-0a88-4041-9e23-38c921877431","Type":"ContainerStarted","Data":"7ead4a3585bee19aabe6b9cd07f1610dac618f0c42fb598e1f55af05c757700a"} Jul 08 19:35:00.888618 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:00.888595 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" event={"ID":"7fd354ff-50fe-4094-9b62-0d3242209b02","Type":"ContainerStarted","Data":"8ca2fa53251e5ff1a5cf00d820c2946646a4a316e76b562262484b31c46a84ef"} Jul 08 19:35:00.890076 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:00.890056 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" event={"ID":"09a78f5e-f733-46ee-9a5d-b4088c709163","Type":"ContainerStarted","Data":"5c0ecec7aeec5d46a6738dea32551a8daddd262d7959986f1920850cb7d95b48"} Jul 08 19:35:00.891651 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:00.891626 2553 generic.go:356] "Generic (PLEG): container finished" podID="ef87ff27-5173-4a5f-b14c-036905e7d02b" containerID="7f55f0d7c17bc8a009e600c869600b29b3769ea968041a1120e1f43fddc1e6a1" exitCode=0 Jul 08 19:35:00.891751 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:00.891729 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grmlv" event={"ID":"ef87ff27-5173-4a5f-b14c-036905e7d02b","Type":"ContainerDied","Data":"7f55f0d7c17bc8a009e600c869600b29b3769ea968041a1120e1f43fddc1e6a1"} Jul 08 19:35:00.893221 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:00.893122 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qgvpz" event={"ID":"ee19b31b-83ec-4cfd-9028-53489b1b36e2","Type":"ContainerStarted","Data":"34e1167ba24cdfea6db9af768a12a083b734a6e576d7d0e9bbaa0dbd2da30286"} Jul 08 19:35:00.893968 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:00.893932 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-krhqb" podStartSLOduration=2.387644897 podStartE2EDuration="21.893920746s" totalImagesPullingTime="19.506275849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:00.893831258 +0000 UTC m=+22.647475514" watchObservedRunningTime="2026-07-08 19:35:00.893920746 +0000 UTC m=+22.647564986" Jul 08 19:35:00.930244 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:00.930159 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r8d4l" podStartSLOduration=3.6431865500000002 podStartE2EDuration="21.930135881s" totalImagesPullingTime="18.286949331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:00.909264424 +0000 UTC m=+22.662908694" watchObservedRunningTime="2026-07-08 19:35:00.930135881 +0000 UTC m=+22.683780104" Jul 08 19:35:00.946754 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:00.946710 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7g4xw" podStartSLOduration=3.635279965 podStartE2EDuration="21.946692927s" totalImagesPullingTime="18.311412962s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:00.946236237 +0000 UTC m=+22.699880502" watchObservedRunningTime="2026-07-08 19:35:00.946692927 +0000 UTC m=+22.700337168" Jul 08 19:35:00.963705 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:00.963666 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j2mdw" podStartSLOduration=2.382372913 podStartE2EDuration="21.963651708s" totalImagesPullingTime="19.581278795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:00.963270486 +0000 UTC m=+22.716914725" watchObservedRunningTime="2026-07-08 19:35:00.963651708 +0000 UTC m=+22.717295949" Jul 08 19:35:00.980188 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:00.980148 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qgvpz" podStartSLOduration=10.375314934 podStartE2EDuration="21.980133384s" totalImagesPullingTime="11.60481845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:00.979957632 +0000 UTC m=+22.733601902" watchObservedRunningTime="2026-07-08 19:35:00.980133384 +0000 UTC m=+22.733777624" Jul 08 19:35:01.772974 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:01.772940 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:35:01.772974 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:01.772974 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:35:01.773499 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:01.773058 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrxb5" podUID="1fca35f1-b001-4ddc-99dd-c7069213abfb" Jul 08 19:35:01.773499 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:01.773185 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:35:01.898905 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:01.898747 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" event={"ID":"a2e57f9a-ec19-418b-bb13-f72ac6c49be0","Type":"ContainerStarted","Data":"d37d94000470063bf338fd9bb61966193ce5a4be359d4452aa89b34ba86aa33c"} Jul 08 19:35:01.898905 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:01.898825 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" event={"ID":"a2e57f9a-ec19-418b-bb13-f72ac6c49be0","Type":"ContainerStarted","Data":"c09e3f5b4a58819311fb7e1ed9bf60ab3aa22153d04924e2e69587c5d5d2ed3c"} Jul 08 19:35:01.900200 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:01.900167 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m9w7f" event={"ID":"aef883e7-e871-424e-ac0a-611d758c8ccd","Type":"ContainerStarted","Data":"63190eaf48ad62727877ad42ce47e14b9fe81357b3c4cb98f94cdabeb08a1483"} Jul 08 19:35:01.915720 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:01.915673 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m9w7f" podStartSLOduration=4.627209002 podStartE2EDuration="22.915658478s" totalImagesPullingTime="18.288449476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:01.915572727 +0000 UTC m=+23.669216997" watchObservedRunningTime="2026-07-08 19:35:01.915658478 +0000 UTC m=+23.669302718" Jul 08 19:35:02.513796 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:02.513449 2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 19:35:02.656707 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:02.656506 2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T19:35:02.51378148Z","UUID":"739d7366-1f13-4e15-b605-9eeab1bae7ac","Handler":null,"Name":"","Endpoint":""} Jul 08 19:35:02.658209 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:02.658184 2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 19:35:02.658328 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:02.658229 2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 19:35:02.772120 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:02.772093 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:35:02.772319 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:02.772189 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nctzg" podUID="22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d" Jul 08 19:35:02.904709 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:02.904671 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" event={"ID":"7fd354ff-50fe-4094-9b62-0d3242209b02","Type":"ContainerStarted","Data":"58462be155fd9d5cf3abf88cd7212f9b2744af1a68ad6f6d99d3a5b7f0935b0e"} Jul 08 19:35:03.296514 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:03.296418 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r8d4l" Jul 08 19:35:03.297077 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:03.297054 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r8d4l" Jul 08 19:35:03.773000 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:03.772738 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:35:03.773141 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:03.772952 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:35:03.773209 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:03.773135 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:35:03.773266 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:03.773240 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrxb5" podUID="1fca35f1-b001-4ddc-99dd-c7069213abfb" Jul 08 19:35:03.910053 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:03.910018 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" event={"ID":"a2e57f9a-ec19-418b-bb13-f72ac6c49be0","Type":"ContainerStarted","Data":"9bdaf1cbcb615f95e541c7fdb8169242e2539ef87bbc713e0484a8731d2f7d7d"} Jul 08 19:35:03.912085 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:03.912056 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" event={"ID":"7fd354ff-50fe-4094-9b62-0d3242209b02","Type":"ContainerStarted","Data":"3196baa4463b759d6a1b3288e9dca2f323c452de0a1f9baf24d46055152c3936"} Jul 08 19:35:03.912324 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:03.912303 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r8d4l" Jul 08 19:35:03.912816 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:03.912795 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r8d4l" Jul 08 19:35:03.946097 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:03.946042 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t64gk" podStartSLOduration=2.490076637 podStartE2EDuration="24.9460251s" totalImagesPullingTime="22.455948463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:03.93125798 +0000 UTC m=+25.684902221" watchObservedRunningTime="2026-07-08 19:35:03.9460251 +0000 UTC m=+25.699669340" Jul 08 19:35:04.242736 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:04.242705 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r8d4l_3adacc1d-0a88-4041-9e23-38c921877431/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:04.344782 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:04.344746 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r8d4l_3adacc1d-0a88-4041-9e23-38c921877431/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:04.772799 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:04.772762 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:35:04.772980 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:04.772911 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nctzg" podUID="22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d" Jul 08 19:35:05.587204 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:05.587015 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r8d4l_3adacc1d-0a88-4041-9e23-38c921877431/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:05.662722 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:05.662653 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-r8d4l_3adacc1d-0a88-4041-9e23-38c921877431/konnectivity-agent/0.log" limit=1024 Jul 08 19:35:05.772865 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:05.772823 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:35:05.772865 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:05.772853 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:35:05.773074 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:05.772956 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrxb5" podUID="1fca35f1-b001-4ddc-99dd-c7069213abfb" Jul 08 19:35:05.773143 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:05.773110 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:35:05.921198 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:05.921085 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" event={"ID":"a2e57f9a-ec19-418b-bb13-f72ac6c49be0","Type":"ContainerStarted","Data":"8310e068f09edc3ca281acf0493adf5300b714b7ff7874da0515103480f14972"} Jul 08 19:35:05.921427 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:05.921393 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:35:05.921640 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:05.921622 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:35:05.938124 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:05.938097 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:35:05.953857 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:05.953805 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" podStartSLOduration=7.35635603 podStartE2EDuration="26.95378829s" totalImagesPullingTime="19.59743226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:05.953257962 +0000 UTC m=+27.706902214" watchObservedRunningTime="2026-07-08 19:35:05.95378829 +0000 UTC m=+27.707432533" Jul 08 19:35:06.772522 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:06.772449 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:35:06.772914 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:06.772607 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nctzg" podUID="22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d" Jul 08 19:35:06.924465 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:06.924343 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:35:06.941048 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:06.941020 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:35:07.266420 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:07.266389 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4n4kl"] Jul 08 19:35:07.266613 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:07.266556 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:35:07.266670 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:07.266650 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:35:07.266954 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:07.266932 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lrxb5"] Jul 08 19:35:07.267058 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:07.267037 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:35:07.267155 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:07.267121 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrxb5" podUID="1fca35f1-b001-4ddc-99dd-c7069213abfb" Jul 08 19:35:07.268747 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:07.268724 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nctzg"] Jul 08 19:35:07.268839 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:07.268825 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:35:07.268943 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:07.268920 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nctzg" podUID="22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d" Jul 08 19:35:07.928053 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:07.928020 2553 generic.go:356] "Generic (PLEG): container finished" podID="ef87ff27-5173-4a5f-b14c-036905e7d02b" containerID="bb488e04106ae4d55143362c5751addf841cae56f255edc98f68175e961bf710" exitCode=0 Jul 08 19:35:07.928413 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:07.928101 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grmlv" event={"ID":"ef87ff27-5173-4a5f-b14c-036905e7d02b","Type":"ContainerDied","Data":"bb488e04106ae4d55143362c5751addf841cae56f255edc98f68175e961bf710"} Jul 08 19:35:08.775094 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:08.774918 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:35:08.775260 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:08.774975 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:35:08.775260 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:08.775162 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrxb5" podUID="1fca35f1-b001-4ddc-99dd-c7069213abfb" Jul 08 19:35:08.775260 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:08.774976 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:35:08.775260 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:08.775226 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nctzg" podUID="22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d" Jul 08 19:35:08.775427 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:08.775332 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:35:09.934845 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:09.934813 2553 generic.go:356] "Generic (PLEG): container finished" podID="ef87ff27-5173-4a5f-b14c-036905e7d02b" containerID="edd4de24843e7a8cd24810cf64191db57eaed7a7fc9c1fdc2b064f7d21987826" exitCode=0 Jul 08 19:35:09.935358 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:09.934880 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grmlv" event={"ID":"ef87ff27-5173-4a5f-b14c-036905e7d02b","Type":"ContainerDied","Data":"edd4de24843e7a8cd24810cf64191db57eaed7a7fc9c1fdc2b064f7d21987826"} Jul 08 19:35:10.775623 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:10.775594 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:35:10.775787 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:10.775594 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:35:10.775787 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:10.775699 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:35:10.775787 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:10.775597 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:35:10.775787 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:10.775761 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nctzg" podUID="22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d" Jul 08 19:35:10.775932 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:10.775848 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrxb5" podUID="1fca35f1-b001-4ddc-99dd-c7069213abfb" Jul 08 19:35:10.939860 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:10.939771 2553 generic.go:356] "Generic (PLEG): container finished" podID="ef87ff27-5173-4a5f-b14c-036905e7d02b" containerID="171ad408aaaf5ff3ae60c87c4fba42f5267ae069ba15a13682871fa9f4ec5225" exitCode=0 Jul 08 19:35:10.939860 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:10.939835 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grmlv" event={"ID":"ef87ff27-5173-4a5f-b14c-036905e7d02b","Type":"ContainerDied","Data":"171ad408aaaf5ff3ae60c87c4fba42f5267ae069ba15a13682871fa9f4ec5225"} Jul 08 19:35:12.355042 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:12.354970 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs\") pod \"network-metrics-daemon-4n4kl\" (UID: \"df97169f-20ad-4b99-b6c8-9cec807f0296\") " pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:35:12.355042 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:12.355045 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret\") pod \"global-pull-secret-syncer-lrxb5\" (UID: \"1fca35f1-b001-4ddc-99dd-c7069213abfb\") " pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:35:12.355669 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:12.355148 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:35:12.355669 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:12.355214 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret podName:1fca35f1-b001-4ddc-99dd-c7069213abfb nodeName:}" failed. No retries permitted until 2026-07-08 19:35:44.355200487 +0000 UTC m=+66.108844706 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret") pod "global-pull-secret-syncer-lrxb5" (UID: "1fca35f1-b001-4ddc-99dd-c7069213abfb") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:35:12.355669 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:12.355148 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:35:12.355669 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:12.355302 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs podName:df97169f-20ad-4b99-b6c8-9cec807f0296 nodeName:}" failed. No retries permitted until 2026-07-08 19:35:44.355278762 +0000 UTC m=+66.108922989 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs") pod "network-metrics-daemon-4n4kl" (UID: "df97169f-20ad-4b99-b6c8-9cec807f0296") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:35:12.455791 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:12.455759 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmjg2\" (UniqueName: \"kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2\") pod \"network-check-target-nctzg\" (UID: \"22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d\") " pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:35:12.455935 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:12.455898 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:35:12.455935 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:12.455915 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:35:12.455935 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:12.455924 2553 projected.go:196] Error preparing data for projected volume kube-api-access-cmjg2 for pod openshift-network-diagnostics/network-check-target-nctzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:35:12.456068 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:12.455985 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2 podName:22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d nodeName:}" failed. No retries permitted until 2026-07-08 19:35:44.455967798 +0000 UTC m=+66.209612020 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cmjg2" (UniqueName: "kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2") pod "network-check-target-nctzg" (UID: "22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:35:12.772425 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:12.772331 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:35:12.772425 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:12.772331 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:35:12.772425 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:12.772340 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:35:12.772681 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:12.772530 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nctzg" podUID="22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d" Jul 08 19:35:12.772681 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:12.772558 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrxb5" podUID="1fca35f1-b001-4ddc-99dd-c7069213abfb" Jul 08 19:35:12.772681 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:12.772632 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:35:13.024758 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.024678 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-108.ec2.internal" event="NodeReady" Jul 08 19:35:13.024905 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.024840 2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 19:35:13.084194 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.084155 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7wfgs"] Jul 08 19:35:13.086337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.086308 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t6lq7"] Jul 08 19:35:13.086504 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.086476 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7wfgs" Jul 08 19:35:13.088504 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.088487 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t6lq7" Jul 08 19:35:13.090311 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.090284 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 19:35:13.090544 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.090531 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6zdff\"" Jul 08 19:35:13.091474 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.091294 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 19:35:13.091474 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.091294 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 19:35:13.091474 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.091295 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dnmhm\"" Jul 08 19:35:13.091474 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.091298 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 19:35:13.091711 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.091652 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 19:35:13.103403 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.103338 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7wfgs"] Jul 08 19:35:13.125783 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.125757 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t6lq7"] Jul 08 19:35:13.160028 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.159998 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54fc0205-6a28-4930-93e0-f1f37776eaaa-cert\") pod \"ingress-canary-t6lq7\" (UID: \"54fc0205-6a28-4930-93e0-f1f37776eaaa\") " pod="openshift-ingress-canary/ingress-canary-t6lq7" Jul 08 19:35:13.160249 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.160032 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6449d116-2ee8-4113-904a-a03e258c4b6b-tmp-dir\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:35:13.160249 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.160091 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6449d116-2ee8-4113-904a-a03e258c4b6b-config-volume\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:35:13.160249 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.160137 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:35:13.160249 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.160157 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwqqh\" (UniqueName: \"kubernetes.io/projected/54fc0205-6a28-4930-93e0-f1f37776eaaa-kube-api-access-nwqqh\") pod \"ingress-canary-t6lq7\" (UID: \"54fc0205-6a28-4930-93e0-f1f37776eaaa\") " pod="openshift-ingress-canary/ingress-canary-t6lq7" Jul 08 19:35:13.160249 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.160193 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4spc\" (UniqueName: \"kubernetes.io/projected/6449d116-2ee8-4113-904a-a03e258c4b6b-kube-api-access-d4spc\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:35:13.261391 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.261356 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4spc\" (UniqueName: \"kubernetes.io/projected/6449d116-2ee8-4113-904a-a03e258c4b6b-kube-api-access-d4spc\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:35:13.261592 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.261417 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54fc0205-6a28-4930-93e0-f1f37776eaaa-cert\") pod \"ingress-canary-t6lq7\" (UID: \"54fc0205-6a28-4930-93e0-f1f37776eaaa\") " pod="openshift-ingress-canary/ingress-canary-t6lq7" Jul 08 19:35:13.261592 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.261471 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6449d116-2ee8-4113-904a-a03e258c4b6b-tmp-dir\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:35:13.261707 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.261658 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6449d116-2ee8-4113-904a-a03e258c4b6b-config-volume\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:35:13.261756 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.261715 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:35:13.261808 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.261752 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwqqh\" (UniqueName: \"kubernetes.io/projected/54fc0205-6a28-4930-93e0-f1f37776eaaa-kube-api-access-nwqqh\") pod \"ingress-canary-t6lq7\" (UID: \"54fc0205-6a28-4930-93e0-f1f37776eaaa\") " pod="openshift-ingress-canary/ingress-canary-t6lq7" Jul 08 19:35:13.261864 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.261835 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6449d116-2ee8-4113-904a-a03e258c4b6b-tmp-dir\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:35:13.261914 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:13.261887 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:35:13.261985 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:13.261970 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls podName:6449d116-2ee8-4113-904a-a03e258c4b6b nodeName:}" failed. No retries permitted until 2026-07-08 19:35:13.761947399 +0000 UTC m=+35.515591619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls") pod "dns-default-7wfgs" (UID: "6449d116-2ee8-4113-904a-a03e258c4b6b") : secret "dns-default-metrics-tls" not found Jul 08 19:35:13.262282 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.262259 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6449d116-2ee8-4113-904a-a03e258c4b6b-config-volume\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:35:13.265813 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.265790 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54fc0205-6a28-4930-93e0-f1f37776eaaa-cert\") pod \"ingress-canary-t6lq7\" (UID: \"54fc0205-6a28-4930-93e0-f1f37776eaaa\") " pod="openshift-ingress-canary/ingress-canary-t6lq7" Jul 08 19:35:13.271381 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.271189 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwqqh\" (UniqueName: \"kubernetes.io/projected/54fc0205-6a28-4930-93e0-f1f37776eaaa-kube-api-access-nwqqh\") pod \"ingress-canary-t6lq7\" (UID: \"54fc0205-6a28-4930-93e0-f1f37776eaaa\") " pod="openshift-ingress-canary/ingress-canary-t6lq7" Jul 08 19:35:13.271581 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.271559 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4spc\" (UniqueName: \"kubernetes.io/projected/6449d116-2ee8-4113-904a-a03e258c4b6b-kube-api-access-d4spc\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:35:13.405328 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.405292 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t6lq7" Jul 08 19:35:13.560912 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.560879 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t6lq7"] Jul 08 19:35:13.564778 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:35:13.564751 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54fc0205_6a28_4930_93e0_f1f37776eaaa.slice/crio-59556eb98b727a4c504014bd6f04b373327320a5bffe0217ba3de37e1ce39cd6 WatchSource:0}: Error finding container 59556eb98b727a4c504014bd6f04b373327320a5bffe0217ba3de37e1ce39cd6: Status 404 returned error can't find the container with id 59556eb98b727a4c504014bd6f04b373327320a5bffe0217ba3de37e1ce39cd6 Jul 08 19:35:13.765355 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.765242 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:35:13.765527 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:13.765368 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:35:13.765527 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:13.765425 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls podName:6449d116-2ee8-4113-904a-a03e258c4b6b nodeName:}" failed. No retries permitted until 2026-07-08 19:35:14.765411412 +0000 UTC m=+36.519055632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls") pod "dns-default-7wfgs" (UID: "6449d116-2ee8-4113-904a-a03e258c4b6b") : secret "dns-default-metrics-tls" not found Jul 08 19:35:13.948366 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:13.948325 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t6lq7" event={"ID":"54fc0205-6a28-4930-93e0-f1f37776eaaa","Type":"ContainerStarted","Data":"59556eb98b727a4c504014bd6f04b373327320a5bffe0217ba3de37e1ce39cd6"} Jul 08 19:35:14.773026 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:14.772991 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:35:14.773589 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:14.773163 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:35:14.773589 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:14.773231 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls podName:6449d116-2ee8-4113-904a-a03e258c4b6b nodeName:}" failed. No retries permitted until 2026-07-08 19:35:16.773208379 +0000 UTC m=+38.526852598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls") pod "dns-default-7wfgs" (UID: "6449d116-2ee8-4113-904a-a03e258c4b6b") : secret "dns-default-metrics-tls" not found Jul 08 19:35:14.777371 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:14.777313 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:35:14.777513 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:14.777422 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:35:14.777513 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:14.777465 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:35:14.781366 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:14.781342 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b6785\"" Jul 08 19:35:14.781366 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:14.781352 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 19:35:14.781571 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:14.781453 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 19:35:14.781676 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:14.781647 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 19:35:14.781762 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:14.781742 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 19:35:14.781854 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:14.781836 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ljxhr\"" Jul 08 19:35:16.791406 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:16.791366 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:35:16.791878 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:16.791557 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:35:16.791878 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:16.791633 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls podName:6449d116-2ee8-4113-904a-a03e258c4b6b nodeName:}" failed. No retries permitted until 2026-07-08 19:35:20.791616258 +0000 UTC m=+42.545260478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls") pod "dns-default-7wfgs" (UID: "6449d116-2ee8-4113-904a-a03e258c4b6b") : secret "dns-default-metrics-tls" not found Jul 08 19:35:17.960450 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:17.960184 2553 generic.go:356] "Generic (PLEG): container finished" podID="ef87ff27-5173-4a5f-b14c-036905e7d02b" containerID="09836461e8a6d6dd5e197dec19612e5ae25b0f187ddde9045040a113f632964d" exitCode=0 Jul 08 19:35:17.960972 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:17.960270 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grmlv" event={"ID":"ef87ff27-5173-4a5f-b14c-036905e7d02b","Type":"ContainerDied","Data":"09836461e8a6d6dd5e197dec19612e5ae25b0f187ddde9045040a113f632964d"} Jul 08 19:35:17.961999 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:17.961977 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t6lq7" event={"ID":"54fc0205-6a28-4930-93e0-f1f37776eaaa","Type":"ContainerStarted","Data":"1713e064176558b9183ecafa5d210383ee4781e25fc698f853478479e077f084"} Jul 08 19:35:18.967067 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:18.967028 2553 generic.go:356] "Generic (PLEG): container finished" podID="ef87ff27-5173-4a5f-b14c-036905e7d02b" containerID="46eed230917761162c39712922be5a2c0b612b26732415add35523076d3be7e4" exitCode=0 Jul 08 19:35:18.967623 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:18.967106 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grmlv" event={"ID":"ef87ff27-5173-4a5f-b14c-036905e7d02b","Type":"ContainerDied","Data":"46eed230917761162c39712922be5a2c0b612b26732415add35523076d3be7e4"} Jul 08 19:35:18.991542 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:18.991500 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t6lq7" podStartSLOduration=2.539862505 podStartE2EDuration="5.991486903s" totalImagesPullingTime="3.451624398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:17.997149476 +0000 UTC m=+39.750793746" watchObservedRunningTime="2026-07-08 19:35:18.991486903 +0000 UTC m=+40.745131151" Jul 08 19:35:19.973262 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:19.973232 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grmlv" event={"ID":"ef87ff27-5173-4a5f-b14c-036905e7d02b","Type":"ContainerStarted","Data":"4a93833392377c940f2652e9f3b9fe6dd15b731561433a6b7bdc14066951a7a7"} Jul 08 19:35:19.999309 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:19.999260 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-grmlv" podStartSLOduration=7.246310481 podStartE2EDuration="40.999241484s" totalImagesPullingTime="33.752931003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:19.994798064 +0000 UTC m=+41.748442304" watchObservedRunningTime="2026-07-08 19:35:19.999241484 +0000 UTC m=+41.752885726" Jul 08 19:35:20.818981 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:20.818941 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:35:20.819161 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:20.819069 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:35:20.819161 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:20.819135 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls podName:6449d116-2ee8-4113-904a-a03e258c4b6b nodeName:}" failed. No retries permitted until 2026-07-08 19:35:28.819118061 +0000 UTC m=+50.572762294 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls") pod "dns-default-7wfgs" (UID: "6449d116-2ee8-4113-904a-a03e258c4b6b") : secret "dns-default-metrics-tls" not found Jul 08 19:35:28.878806 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:28.878763 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:35:28.879279 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:28.878903 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:35:28.879279 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:28.879020 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls podName:6449d116-2ee8-4113-904a-a03e258c4b6b nodeName:}" failed. No retries permitted until 2026-07-08 19:35:44.878999719 +0000 UTC m=+66.632643940 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls") pod "dns-default-7wfgs" (UID: "6449d116-2ee8-4113-904a-a03e258c4b6b") : secret "dns-default-metrics-tls" not found Jul 08 19:35:38.952161 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:38.952130 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9rnh" Jul 08 19:35:44.395671 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:44.395625 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret\") pod \"global-pull-secret-syncer-lrxb5\" (UID: \"1fca35f1-b001-4ddc-99dd-c7069213abfb\") " pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:35:44.395671 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:44.395674 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs\") pod \"network-metrics-daemon-4n4kl\" (UID: \"df97169f-20ad-4b99-b6c8-9cec807f0296\") " pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:35:44.398764 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:44.398744 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 19:35:44.398870 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:44.398855 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 19:35:44.405972 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:44.405952 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 19:35:44.406061 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:44.406039 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs podName:df97169f-20ad-4b99-b6c8-9cec807f0296 nodeName:}" failed. No retries permitted until 2026-07-08 19:36:48.406016807 +0000 UTC m=+130.159661027 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs") pod "network-metrics-daemon-4n4kl" (UID: "df97169f-20ad-4b99-b6c8-9cec807f0296") : secret "metrics-daemon-secret" not found Jul 08 19:35:44.409509 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:44.409485 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fca35f1-b001-4ddc-99dd-c7069213abfb-original-pull-secret\") pod \"global-pull-secret-syncer-lrxb5\" (UID: \"1fca35f1-b001-4ddc-99dd-c7069213abfb\") " pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:35:44.496536 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:44.496501 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmjg2\" (UniqueName: \"kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2\") pod \"network-check-target-nctzg\" (UID: \"22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d\") " pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:35:44.498479 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:44.498453 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrxb5" Jul 08 19:35:44.499301 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:44.499279 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 19:35:44.509817 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:44.509793 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 19:35:44.520176 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:44.520152 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmjg2\" (UniqueName: \"kubernetes.io/projected/22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d-kube-api-access-cmjg2\") pod \"network-check-target-nctzg\" (UID: \"22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d\") " pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:35:44.615221 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:44.615180 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lrxb5"] Jul 08 19:35:44.619544 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:35:44.619516 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fca35f1_b001_4ddc_99dd_c7069213abfb.slice/crio-5f13a9629bd4dd3be30935061e9feae01ca1e39315909ee68355292733bc9563 WatchSource:0}: Error finding container 5f13a9629bd4dd3be30935061e9feae01ca1e39315909ee68355292733bc9563: Status 404 returned error can't find the container with id 5f13a9629bd4dd3be30935061e9feae01ca1e39315909ee68355292733bc9563 Jul 08 19:35:44.794020 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:44.793994 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ljxhr\"" Jul 08 19:35:44.802289 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:44.802267 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:35:44.903469 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:44.901737 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:35:44.903469 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:44.901921 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:35:44.903469 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:35:44.901981 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls podName:6449d116-2ee8-4113-904a-a03e258c4b6b nodeName:}" failed. No retries permitted until 2026-07-08 19:36:16.901963069 +0000 UTC m=+98.655607302 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls") pod "dns-default-7wfgs" (UID: "6449d116-2ee8-4113-904a-a03e258c4b6b") : secret "dns-default-metrics-tls" not found Jul 08 19:35:44.928734 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:44.928695 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nctzg"] Jul 08 19:35:44.931264 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:35:44.931239 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22d7a36f_1f49_4ca3_bb5c_a26d41ddb36d.slice/crio-5bc0ff196a43243a2e249dd71263c2e53c1195561bad84919abbcc31c0386021 WatchSource:0}: Error finding container 5bc0ff196a43243a2e249dd71263c2e53c1195561bad84919abbcc31c0386021: Status 404 returned error can't find the container with id 5bc0ff196a43243a2e249dd71263c2e53c1195561bad84919abbcc31c0386021 Jul 08 19:35:45.033284 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:45.033245 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nctzg" event={"ID":"22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d","Type":"ContainerStarted","Data":"5bc0ff196a43243a2e249dd71263c2e53c1195561bad84919abbcc31c0386021"} Jul 08 19:35:45.035278 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:45.035189 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lrxb5" event={"ID":"1fca35f1-b001-4ddc-99dd-c7069213abfb","Type":"ContainerStarted","Data":"5f13a9629bd4dd3be30935061e9feae01ca1e39315909ee68355292733bc9563"} Jul 08 19:35:50.050142 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:50.050108 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nctzg" event={"ID":"22d7a36f-1f49-4ca3-bb5c-a26d41ddb36d","Type":"ContainerStarted","Data":"0ca4ae58666a68e5a951a58858d550a0a8fc681332d3fb1ccf940b125fafbf5a"} Jul 08 19:35:50.050623 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:50.050237 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:35:50.051640 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:50.051610 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lrxb5" event={"ID":"1fca35f1-b001-4ddc-99dd-c7069213abfb","Type":"ContainerStarted","Data":"22744a2c6d15820c8dd7704a30849cf9d60af402d192e4fd4ecdacdefde06631"} Jul 08 19:35:50.066251 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:50.066167 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nctzg" podStartSLOduration=66.185631779 podStartE2EDuration="1m11.066146654s" totalImagesPullingTime="4.880514875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:50.06514183 +0000 UTC m=+71.818786072" watchObservedRunningTime="2026-07-08 19:35:50.066146654 +0000 UTC m=+71.819790895" Jul 08 19:35:50.078873 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:35:50.078832 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lrxb5" podStartSLOduration=65.88655356 podStartE2EDuration="1m11.078818566s" totalImagesPullingTime="5.192265006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:35:50.078575938 +0000 UTC m=+71.832220181" watchObservedRunningTime="2026-07-08 19:35:50.078818566 +0000 UTC m=+71.832462814" Jul 08 19:36:16.909899 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:36:16.909847 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:36:16.910274 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:36:16.909982 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:36:16.910274 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:36:16.910046 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls podName:6449d116-2ee8-4113-904a-a03e258c4b6b nodeName:}" failed. No retries permitted until 2026-07-08 19:37:20.910028441 +0000 UTC m=+162.663672664 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls") pod "dns-default-7wfgs" (UID: "6449d116-2ee8-4113-904a-a03e258c4b6b") : secret "dns-default-metrics-tls" not found Jul 08 19:36:21.056213 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:36:21.056174 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nctzg" Jul 08 19:36:48.415629 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:36:48.415582 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs\") pod \"network-metrics-daemon-4n4kl\" (UID: \"df97169f-20ad-4b99-b6c8-9cec807f0296\") " pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:36:48.416031 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:36:48.415701 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 19:36:48.416031 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:36:48.415757 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs podName:df97169f-20ad-4b99-b6c8-9cec807f0296 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:50.415741925 +0000 UTC m=+252.169386144 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs") pod "network-metrics-daemon-4n4kl" (UID: "df97169f-20ad-4b99-b6c8-9cec807f0296") : secret "metrics-daemon-secret" not found Jul 08 19:37:16.098778 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:37:16.098729 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7wfgs" podUID="6449d116-2ee8-4113-904a-a03e258c4b6b" Jul 08 19:37:16.251559 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:37:16.251531 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7wfgs" Jul 08 19:37:17.805859 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:37:17.805815 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:37:20.925369 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:37:20.925326 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:37:20.925757 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:37:20.925462 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 19:37:20.925757 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:37:20.925528 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls podName:6449d116-2ee8-4113-904a-a03e258c4b6b nodeName:}" failed. No retries permitted until 2026-07-08 19:39:22.925512762 +0000 UTC m=+284.679156981 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls") pod "dns-default-7wfgs" (UID: "6449d116-2ee8-4113-904a-a03e258c4b6b") : secret "dns-default-metrics-tls" not found Jul 08 19:37:29.772586 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:37:29.772546 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:38:47.795986 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.795956 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-8lthk"] Jul 08 19:38:47.797701 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.797685 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8lthk" Jul 08 19:38:47.801268 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.801246 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-k7zhg\"" Jul 08 19:38:47.808911 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.808889 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56bfdf68c-v5vpx"] Jul 08 19:38:47.810558 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.810542 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.814334 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.814311 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 19:38:47.814477 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.814455 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 19:38:47.814789 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.814765 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tq925\"" Jul 08 19:38:47.815733 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.815710 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 19:38:47.819716 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.819646 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 19:38:47.836082 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.836059 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-8lthk"] Jul 08 19:38:47.840190 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.840168 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56bfdf68c-v5vpx"] Jul 08 19:38:47.891054 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.891029 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z9fm\" (UniqueName: \"kubernetes.io/projected/9d2760c4-5be2-4a9b-8c2b-d218b638610c-kube-api-access-5z9fm\") pod \"network-check-source-989f8b8dc-8lthk\" (UID: \"9d2760c4-5be2-4a9b-8c2b-d218b638610c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8lthk" Jul 08 19:38:47.891187 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.891061 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c80a8750-07c5-4528-b873-81869857a54c-image-registry-private-configuration\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.891187 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.891077 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-bound-sa-token\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.891187 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.891097 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.891187 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.891123 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c80a8750-07c5-4528-b873-81869857a54c-registry-certificates\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.891187 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.891145 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c80a8750-07c5-4528-b873-81869857a54c-trusted-ca\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.891187 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.891168 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcdg8\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-kube-api-access-tcdg8\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.891477 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.891200 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c80a8750-07c5-4528-b873-81869857a54c-ca-trust-extracted\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.891477 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.891222 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c80a8750-07c5-4528-b873-81869857a54c-installation-pull-secrets\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.891847 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.891830 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc"] Jul 08 19:38:47.893707 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.893693 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc" Jul 08 19:38:47.896081 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.896059 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nprm9\"" Jul 08 19:38:47.896196 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.896098 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-gcp4k"] Jul 08 19:38:47.896989 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.896969 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 08 19:38:47.896989 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.896985 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:38:47.897463 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.897431 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 08 19:38:47.897741 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.897726 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n"] Jul 08 19:38:47.897829 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.897816 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:47.899325 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.899309 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n" Jul 08 19:38:47.900628 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.900600 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-gh46n"] Jul 08 19:38:47.900628 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.900626 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 19:38:47.900790 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.900662 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 08 19:38:47.900790 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.900608 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dmrtw\"" Jul 08 19:38:47.900790 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.900740 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 08 19:38:47.901007 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.900992 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 19:38:47.902374 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.902353 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:38:47.902892 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.902878 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:38:47.903217 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.903180 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 08 19:38:47.903259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.903233 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ck6xb\"" Jul 08 19:38:47.903664 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.903651 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 08 19:38:47.903930 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.903916 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 08 19:38:47.907925 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.907906 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:38:47.908127 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.908104 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 08 19:38:47.908330 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.908314 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 08 19:38:47.908404 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.908327 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 08 19:38:47.908490 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.908364 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xhskq\"" Jul 08 19:38:47.909011 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.908988 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc"] Jul 08 19:38:47.912408 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.912388 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 08 19:38:47.914534 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.914512 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 08 19:38:47.917022 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.916999 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n"] Jul 08 19:38:47.917855 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.917836 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-gcp4k"] Jul 08 19:38:47.918701 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.918636 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-gh46n"] Jul 08 19:38:47.992083 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992056 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cde4c83a-9651-4090-8008-65ea0e65cdf0-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-cl26n\" (UID: \"cde4c83a-9651-4090-8008-65ea0e65cdf0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n" Jul 08 19:38:47.992083 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992085 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d41e4e9-4418-4797-acea-bca615f11b0f-config\") pod \"console-operator-68b757fb67-gh46n\" (UID: \"9d41e4e9-4418-4797-acea-bca615f11b0f\") " pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:38:47.992272 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992109 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d41e4e9-4418-4797-acea-bca615f11b0f-trusted-ca\") pod \"console-operator-68b757fb67-gh46n\" (UID: \"9d41e4e9-4418-4797-acea-bca615f11b0f\") " pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:38:47.992272 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992129 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8078098-b1d0-4222-b1eb-9c116df84482-serving-cert\") pod \"insights-operator-5c847dcfc4-gcp4k\" (UID: \"a8078098-b1d0-4222-b1eb-9c116df84482\") " pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:47.992272 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992172 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8078098-b1d0-4222-b1eb-9c116df84482-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-gcp4k\" (UID: \"a8078098-b1d0-4222-b1eb-9c116df84482\") " pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:47.992272 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992232 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcx8b\" (UniqueName: \"kubernetes.io/projected/a8078098-b1d0-4222-b1eb-9c116df84482-kube-api-access-dcx8b\") pod \"insights-operator-5c847dcfc4-gcp4k\" (UID: \"a8078098-b1d0-4222-b1eb-9c116df84482\") " pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:47.992466 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992282 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z9fm\" (UniqueName: \"kubernetes.io/projected/9d2760c4-5be2-4a9b-8c2b-d218b638610c-kube-api-access-5z9fm\") pod \"network-check-source-989f8b8dc-8lthk\" (UID: \"9d2760c4-5be2-4a9b-8c2b-d218b638610c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8lthk" Jul 08 19:38:47.992466 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992303 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c80a8750-07c5-4528-b873-81869857a54c-image-registry-private-configuration\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.992466 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992319 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-bound-sa-token\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.992466 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992339 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcdg8\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-kube-api-access-tcdg8\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.992466 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992370 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzcfb\" (UniqueName: \"kubernetes.io/projected/cde4c83a-9651-4090-8008-65ea0e65cdf0-kube-api-access-wzcfb\") pod \"kube-storage-version-migrator-operator-846bf668f7-cl26n\" (UID: \"cde4c83a-9651-4090-8008-65ea0e65cdf0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n" Jul 08 19:38:47.992466 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992397 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c80a8750-07c5-4528-b873-81869857a54c-registry-certificates\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.992466 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992426 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c80a8750-07c5-4528-b873-81869857a54c-installation-pull-secrets\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.992890 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992480 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7ppx\" (UniqueName: \"kubernetes.io/projected/ac461a89-bf5e-4a12-872b-ca3a47602be5-kube-api-access-m7ppx\") pod \"cluster-samples-operator-56fcf86bf-v9rpc\" (UID: \"ac461a89-bf5e-4a12-872b-ca3a47602be5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc" Jul 08 19:38:47.992890 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992523 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8078098-b1d0-4222-b1eb-9c116df84482-tmp\") pod \"insights-operator-5c847dcfc4-gcp4k\" (UID: \"a8078098-b1d0-4222-b1eb-9c116df84482\") " pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:47.992890 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992555 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d41e4e9-4418-4797-acea-bca615f11b0f-serving-cert\") pod \"console-operator-68b757fb67-gh46n\" (UID: \"9d41e4e9-4418-4797-acea-bca615f11b0f\") " pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:38:47.992890 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992584 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac461a89-bf5e-4a12-872b-ca3a47602be5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-v9rpc\" (UID: \"ac461a89-bf5e-4a12-872b-ca3a47602be5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc" Jul 08 19:38:47.992890 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992614 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.992890 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992642 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwmd9\" (UniqueName: \"kubernetes.io/projected/9d41e4e9-4418-4797-acea-bca615f11b0f-kube-api-access-wwmd9\") pod \"console-operator-68b757fb67-gh46n\" (UID: \"9d41e4e9-4418-4797-acea-bca615f11b0f\") " pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:38:47.992890 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992668 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8078098-b1d0-4222-b1eb-9c116df84482-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-gcp4k\" (UID: \"a8078098-b1d0-4222-b1eb-9c116df84482\") " pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:47.992890 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992702 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c80a8750-07c5-4528-b873-81869857a54c-trusted-ca\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.992890 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:47.992730 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:38:47.992890 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:47.992747 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56bfdf68c-v5vpx: secret "image-registry-tls" not found Jul 08 19:38:47.992890 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992744 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a8078098-b1d0-4222-b1eb-9c116df84482-snapshots\") pod \"insights-operator-5c847dcfc4-gcp4k\" (UID: \"a8078098-b1d0-4222-b1eb-9c116df84482\") " pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:47.992890 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992786 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c80a8750-07c5-4528-b873-81869857a54c-ca-trust-extracted\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.992890 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:47.992806 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls podName:c80a8750-07c5-4528-b873-81869857a54c nodeName:}" failed. No retries permitted until 2026-07-08 19:38:48.492786079 +0000 UTC m=+250.246430299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls") pod "image-registry-56bfdf68c-v5vpx" (UID: "c80a8750-07c5-4528-b873-81869857a54c") : secret "image-registry-tls" not found Jul 08 19:38:47.992890 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.992834 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cde4c83a-9651-4090-8008-65ea0e65cdf0-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-cl26n\" (UID: \"cde4c83a-9651-4090-8008-65ea0e65cdf0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n" Jul 08 19:38:47.993613 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.993080 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c80a8750-07c5-4528-b873-81869857a54c-ca-trust-extracted\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.993613 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.993105 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c80a8750-07c5-4528-b873-81869857a54c-registry-certificates\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.993717 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.993702 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c80a8750-07c5-4528-b873-81869857a54c-trusted-ca\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.994720 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.994694 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c80a8750-07c5-4528-b873-81869857a54c-installation-pull-secrets\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:47.994841 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:47.994824 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c80a8750-07c5-4528-b873-81869857a54c-image-registry-private-configuration\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:48.001248 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.001229 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z9fm\" (UniqueName: \"kubernetes.io/projected/9d2760c4-5be2-4a9b-8c2b-d218b638610c-kube-api-access-5z9fm\") pod \"network-check-source-989f8b8dc-8lthk\" (UID: \"9d2760c4-5be2-4a9b-8c2b-d218b638610c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8lthk" Jul 08 19:38:48.002052 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.002026 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcdg8\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-kube-api-access-tcdg8\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:48.002330 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.002310 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-bound-sa-token\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:48.093200 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.093119 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a8078098-b1d0-4222-b1eb-9c116df84482-snapshots\") pod \"insights-operator-5c847dcfc4-gcp4k\" (UID: \"a8078098-b1d0-4222-b1eb-9c116df84482\") " pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:48.093200 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.093157 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cde4c83a-9651-4090-8008-65ea0e65cdf0-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-cl26n\" (UID: \"cde4c83a-9651-4090-8008-65ea0e65cdf0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n" Jul 08 19:38:48.093200 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.093178 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cde4c83a-9651-4090-8008-65ea0e65cdf0-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-cl26n\" (UID: \"cde4c83a-9651-4090-8008-65ea0e65cdf0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n" Jul 08 19:38:48.093383 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.093297 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d41e4e9-4418-4797-acea-bca615f11b0f-config\") pod \"console-operator-68b757fb67-gh46n\" (UID: \"9d41e4e9-4418-4797-acea-bca615f11b0f\") " pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:38:48.093383 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.093333 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d41e4e9-4418-4797-acea-bca615f11b0f-trusted-ca\") pod \"console-operator-68b757fb67-gh46n\" (UID: \"9d41e4e9-4418-4797-acea-bca615f11b0f\") " pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:38:48.093383 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.093377 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8078098-b1d0-4222-b1eb-9c116df84482-serving-cert\") pod \"insights-operator-5c847dcfc4-gcp4k\" (UID: \"a8078098-b1d0-4222-b1eb-9c116df84482\") " pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:48.093533 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.093422 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8078098-b1d0-4222-b1eb-9c116df84482-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-gcp4k\" (UID: \"a8078098-b1d0-4222-b1eb-9c116df84482\") " pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:48.093533 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.093480 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcx8b\" (UniqueName: \"kubernetes.io/projected/a8078098-b1d0-4222-b1eb-9c116df84482-kube-api-access-dcx8b\") pod \"insights-operator-5c847dcfc4-gcp4k\" (UID: \"a8078098-b1d0-4222-b1eb-9c116df84482\") " pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:48.093533 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.093518 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzcfb\" (UniqueName: \"kubernetes.io/projected/cde4c83a-9651-4090-8008-65ea0e65cdf0-kube-api-access-wzcfb\") pod \"kube-storage-version-migrator-operator-846bf668f7-cl26n\" (UID: \"cde4c83a-9651-4090-8008-65ea0e65cdf0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n" Jul 08 19:38:48.093680 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.093563 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7ppx\" (UniqueName: \"kubernetes.io/projected/ac461a89-bf5e-4a12-872b-ca3a47602be5-kube-api-access-m7ppx\") pod \"cluster-samples-operator-56fcf86bf-v9rpc\" (UID: \"ac461a89-bf5e-4a12-872b-ca3a47602be5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc" Jul 08 19:38:48.093680 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.093604 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8078098-b1d0-4222-b1eb-9c116df84482-tmp\") pod \"insights-operator-5c847dcfc4-gcp4k\" (UID: \"a8078098-b1d0-4222-b1eb-9c116df84482\") " pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:48.093680 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.093626 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d41e4e9-4418-4797-acea-bca615f11b0f-serving-cert\") pod \"console-operator-68b757fb67-gh46n\" (UID: \"9d41e4e9-4418-4797-acea-bca615f11b0f\") " pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:38:48.093680 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.093652 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac461a89-bf5e-4a12-872b-ca3a47602be5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-v9rpc\" (UID: \"ac461a89-bf5e-4a12-872b-ca3a47602be5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc" Jul 08 19:38:48.093872 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.093689 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwmd9\" (UniqueName: \"kubernetes.io/projected/9d41e4e9-4418-4797-acea-bca615f11b0f-kube-api-access-wwmd9\") pod \"console-operator-68b757fb67-gh46n\" (UID: \"9d41e4e9-4418-4797-acea-bca615f11b0f\") " pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:38:48.093872 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.093712 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8078098-b1d0-4222-b1eb-9c116df84482-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-gcp4k\" (UID: \"a8078098-b1d0-4222-b1eb-9c116df84482\") " pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:48.093872 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.093784 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cde4c83a-9651-4090-8008-65ea0e65cdf0-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-cl26n\" (UID: \"cde4c83a-9651-4090-8008-65ea0e65cdf0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n" Jul 08 19:38:48.093872 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.093855 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a8078098-b1d0-4222-b1eb-9c116df84482-snapshots\") pod \"insights-operator-5c847dcfc4-gcp4k\" (UID: \"a8078098-b1d0-4222-b1eb-9c116df84482\") " pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:48.094070 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.094052 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d41e4e9-4418-4797-acea-bca615f11b0f-config\") pod \"console-operator-68b757fb67-gh46n\" (UID: \"9d41e4e9-4418-4797-acea-bca615f11b0f\") " pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:38:48.094165 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:48.094143 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 19:38:48.094242 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:48.094221 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac461a89-bf5e-4a12-872b-ca3a47602be5-samples-operator-tls podName:ac461a89-bf5e-4a12-872b-ca3a47602be5 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:48.594201249 +0000 UTC m=+250.347845476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac461a89-bf5e-4a12-872b-ca3a47602be5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-v9rpc" (UID: "ac461a89-bf5e-4a12-872b-ca3a47602be5") : secret "samples-operator-tls" not found Jul 08 19:38:48.094303 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.094277 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8078098-b1d0-4222-b1eb-9c116df84482-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-gcp4k\" (UID: \"a8078098-b1d0-4222-b1eb-9c116df84482\") " pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:48.094303 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.094277 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d41e4e9-4418-4797-acea-bca615f11b0f-trusted-ca\") pod \"console-operator-68b757fb67-gh46n\" (UID: \"9d41e4e9-4418-4797-acea-bca615f11b0f\") " pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:38:48.094607 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.094581 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8078098-b1d0-4222-b1eb-9c116df84482-tmp\") pod \"insights-operator-5c847dcfc4-gcp4k\" (UID: \"a8078098-b1d0-4222-b1eb-9c116df84482\") " pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:48.094689 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.094613 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8078098-b1d0-4222-b1eb-9c116df84482-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-gcp4k\" (UID: \"a8078098-b1d0-4222-b1eb-9c116df84482\") " pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:48.095978 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.095953 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cde4c83a-9651-4090-8008-65ea0e65cdf0-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-cl26n\" (UID: \"cde4c83a-9651-4090-8008-65ea0e65cdf0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n" Jul 08 19:38:48.096059 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.095959 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8078098-b1d0-4222-b1eb-9c116df84482-serving-cert\") pod \"insights-operator-5c847dcfc4-gcp4k\" (UID: \"a8078098-b1d0-4222-b1eb-9c116df84482\") " pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:48.096320 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.096299 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d41e4e9-4418-4797-acea-bca615f11b0f-serving-cert\") pod \"console-operator-68b757fb67-gh46n\" (UID: \"9d41e4e9-4418-4797-acea-bca615f11b0f\") " pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:38:48.102490 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.102424 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzcfb\" (UniqueName: \"kubernetes.io/projected/cde4c83a-9651-4090-8008-65ea0e65cdf0-kube-api-access-wzcfb\") pod \"kube-storage-version-migrator-operator-846bf668f7-cl26n\" (UID: \"cde4c83a-9651-4090-8008-65ea0e65cdf0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n" Jul 08 19:38:48.102679 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.102655 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7ppx\" (UniqueName: \"kubernetes.io/projected/ac461a89-bf5e-4a12-872b-ca3a47602be5-kube-api-access-m7ppx\") pod \"cluster-samples-operator-56fcf86bf-v9rpc\" (UID: \"ac461a89-bf5e-4a12-872b-ca3a47602be5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc" Jul 08 19:38:48.102758 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.102715 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwmd9\" (UniqueName: \"kubernetes.io/projected/9d41e4e9-4418-4797-acea-bca615f11b0f-kube-api-access-wwmd9\") pod \"console-operator-68b757fb67-gh46n\" (UID: \"9d41e4e9-4418-4797-acea-bca615f11b0f\") " pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:38:48.102758 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.102752 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcx8b\" (UniqueName: \"kubernetes.io/projected/a8078098-b1d0-4222-b1eb-9c116df84482-kube-api-access-dcx8b\") pod \"insights-operator-5c847dcfc4-gcp4k\" (UID: \"a8078098-b1d0-4222-b1eb-9c116df84482\") " pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:48.106509 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.106490 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8lthk" Jul 08 19:38:48.211060 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.211031 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" Jul 08 19:38:48.219942 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.219923 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n" Jul 08 19:38:48.224418 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.224393 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-8lthk"] Jul 08 19:38:48.224657 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.224639 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:38:48.226775 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:38:48.226746 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2760c4_5be2_4a9b_8c2b_d218b638610c.slice/crio-607993b661be724cc7d8a47c4269e42ec40d7b24f6287e2a070dce9c3bc61fee WatchSource:0}: Error finding container 607993b661be724cc7d8a47c4269e42ec40d7b24f6287e2a070dce9c3bc61fee: Status 404 returned error can't find the container with id 607993b661be724cc7d8a47c4269e42ec40d7b24f6287e2a070dce9c3bc61fee Jul 08 19:38:48.355491 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.355397 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-gcp4k"] Jul 08 19:38:48.360163 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:38:48.360129 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8078098_b1d0_4222_b1eb_9c116df84482.slice/crio-7887caea718795c159f7282859af465cff0d51b7f49a6e4d22b401007b246ac9 WatchSource:0}: Error finding container 7887caea718795c159f7282859af465cff0d51b7f49a6e4d22b401007b246ac9: Status 404 returned error can't find the container with id 7887caea718795c159f7282859af465cff0d51b7f49a6e4d22b401007b246ac9 Jul 08 19:38:48.371978 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.371888 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n"] Jul 08 19:38:48.374622 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:38:48.374598 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde4c83a_9651_4090_8008_65ea0e65cdf0.slice/crio-fd0ea59dd6c9065c8019e0824711b43120481688cd6af796844d48b161030b27 WatchSource:0}: Error finding container fd0ea59dd6c9065c8019e0824711b43120481688cd6af796844d48b161030b27: Status 404 returned error can't find the container with id fd0ea59dd6c9065c8019e0824711b43120481688cd6af796844d48b161030b27 Jul 08 19:38:48.387573 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.387550 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-gh46n"] Jul 08 19:38:48.390039 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:38:48.390015 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d41e4e9_4418_4797_acea_bca615f11b0f.slice/crio-b8c66781d831d8e94ae921e4f0db11fb4293f6d68a8e3fc277add867927ad905 WatchSource:0}: Error finding container b8c66781d831d8e94ae921e4f0db11fb4293f6d68a8e3fc277add867927ad905: Status 404 returned error can't find the container with id b8c66781d831d8e94ae921e4f0db11fb4293f6d68a8e3fc277add867927ad905 Jul 08 19:38:48.459746 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.459725 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" event={"ID":"9d41e4e9-4418-4797-acea-bca615f11b0f","Type":"ContainerStarted","Data":"b8c66781d831d8e94ae921e4f0db11fb4293f6d68a8e3fc277add867927ad905"} Jul 08 19:38:48.460847 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.460819 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n" event={"ID":"cde4c83a-9651-4090-8008-65ea0e65cdf0","Type":"ContainerStarted","Data":"fd0ea59dd6c9065c8019e0824711b43120481688cd6af796844d48b161030b27"} Jul 08 19:38:48.462298 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.462277 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8lthk" event={"ID":"9d2760c4-5be2-4a9b-8c2b-d218b638610c","Type":"ContainerStarted","Data":"af2e71ac7d52519dee6e1c8593c34e6f9a365fc6ce6c3e4f5a79c2e78b603c77"} Jul 08 19:38:48.462374 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.462316 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8lthk" event={"ID":"9d2760c4-5be2-4a9b-8c2b-d218b638610c","Type":"ContainerStarted","Data":"607993b661be724cc7d8a47c4269e42ec40d7b24f6287e2a070dce9c3bc61fee"} Jul 08 19:38:48.463385 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.463365 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" event={"ID":"a8078098-b1d0-4222-b1eb-9c116df84482","Type":"ContainerStarted","Data":"7887caea718795c159f7282859af465cff0d51b7f49a6e4d22b401007b246ac9"} Jul 08 19:38:48.478565 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.478527 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8lthk" podStartSLOduration=1.478514379 podStartE2EDuration="1.478514379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:38:48.477681038 +0000 UTC m=+250.231325278" watchObservedRunningTime="2026-07-08 19:38:48.478514379 +0000 UTC m=+250.232158620" Jul 08 19:38:48.496928 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.496907 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:48.497061 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:48.497044 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:38:48.497118 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:48.497062 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56bfdf68c-v5vpx: secret "image-registry-tls" not found Jul 08 19:38:48.497118 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:48.497107 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls podName:c80a8750-07c5-4528-b873-81869857a54c nodeName:}" failed. No retries permitted until 2026-07-08 19:38:49.497094446 +0000 UTC m=+251.250738665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls") pod "image-registry-56bfdf68c-v5vpx" (UID: "c80a8750-07c5-4528-b873-81869857a54c") : secret "image-registry-tls" not found Jul 08 19:38:48.597741 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:48.597712 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac461a89-bf5e-4a12-872b-ca3a47602be5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-v9rpc\" (UID: \"ac461a89-bf5e-4a12-872b-ca3a47602be5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc" Jul 08 19:38:48.597902 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:48.597844 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 19:38:48.597902 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:48.597895 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac461a89-bf5e-4a12-872b-ca3a47602be5-samples-operator-tls podName:ac461a89-bf5e-4a12-872b-ca3a47602be5 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:49.597879555 +0000 UTC m=+251.351523775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac461a89-bf5e-4a12-872b-ca3a47602be5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-v9rpc" (UID: "ac461a89-bf5e-4a12-872b-ca3a47602be5") : secret "samples-operator-tls" not found Jul 08 19:38:49.509572 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:49.509534 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:49.510026 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:49.509685 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:38:49.510026 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:49.509702 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56bfdf68c-v5vpx: secret "image-registry-tls" not found Jul 08 19:38:49.510026 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:49.509766 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls podName:c80a8750-07c5-4528-b873-81869857a54c nodeName:}" failed. No retries permitted until 2026-07-08 19:38:51.509746781 +0000 UTC m=+253.263391004 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls") pod "image-registry-56bfdf68c-v5vpx" (UID: "c80a8750-07c5-4528-b873-81869857a54c") : secret "image-registry-tls" not found Jul 08 19:38:49.610127 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:49.610090 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac461a89-bf5e-4a12-872b-ca3a47602be5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-v9rpc\" (UID: \"ac461a89-bf5e-4a12-872b-ca3a47602be5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc" Jul 08 19:38:49.610352 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:49.610261 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 19:38:49.610352 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:49.610339 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac461a89-bf5e-4a12-872b-ca3a47602be5-samples-operator-tls podName:ac461a89-bf5e-4a12-872b-ca3a47602be5 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:51.610317317 +0000 UTC m=+253.363961535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac461a89-bf5e-4a12-872b-ca3a47602be5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-v9rpc" (UID: "ac461a89-bf5e-4a12-872b-ca3a47602be5") : secret "samples-operator-tls" not found Jul 08 19:38:50.416465 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:50.416422 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs\") pod \"network-metrics-daemon-4n4kl\" (UID: \"df97169f-20ad-4b99-b6c8-9cec807f0296\") " pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:38:50.416646 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:50.416581 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 19:38:50.416709 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:50.416657 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs podName:df97169f-20ad-4b99-b6c8-9cec807f0296 nodeName:}" failed. No retries permitted until 2026-07-08 19:40:52.416636077 +0000 UTC m=+374.170280298 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs") pod "network-metrics-daemon-4n4kl" (UID: "df97169f-20ad-4b99-b6c8-9cec807f0296") : secret "metrics-daemon-secret" not found Jul 08 19:38:51.473251 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:51.473218 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gh46n_9d41e4e9-4418-4797-acea-bca615f11b0f/console-operator/0.log" Jul 08 19:38:51.473642 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:51.473267 2553 generic.go:356] "Generic (PLEG): container finished" podID="9d41e4e9-4418-4797-acea-bca615f11b0f" containerID="368637af5f0279e721ea764c63410ede6afb0913682fbffc1014c80d42a53ed3" exitCode=255 Jul 08 19:38:51.473642 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:51.473345 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" event={"ID":"9d41e4e9-4418-4797-acea-bca615f11b0f","Type":"ContainerDied","Data":"368637af5f0279e721ea764c63410ede6afb0913682fbffc1014c80d42a53ed3"} Jul 08 19:38:51.473642 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:51.473560 2553 scope.go:117] "RemoveContainer" containerID="368637af5f0279e721ea764c63410ede6afb0913682fbffc1014c80d42a53ed3" Jul 08 19:38:51.475008 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:51.474974 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n" event={"ID":"cde4c83a-9651-4090-8008-65ea0e65cdf0","Type":"ContainerStarted","Data":"4d88ba35bfd6d3637f65f3c51b83392d53ab10751f80fab42b3ac424cedd847b"} Jul 08 19:38:51.476546 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:51.476513 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" event={"ID":"a8078098-b1d0-4222-b1eb-9c116df84482","Type":"ContainerStarted","Data":"f6642d6a6bf515529ce7baff46a63eb33ac922c3599c3f8d54ed0dbae17917e3"} Jul 08 19:38:51.511612 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:51.511566 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" podStartSLOduration=1.611225651 podStartE2EDuration="4.511547099s" totalImagesPullingTime="2.900321448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:38:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:38:51.509773339 +0000 UTC m=+253.263417581" watchObservedRunningTime="2026-07-08 19:38:51.511547099 +0000 UTC m=+253.265191341" Jul 08 19:38:51.526755 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:51.526258 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:51.526867 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:51.526833 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:38:51.526867 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:51.526851 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56bfdf68c-v5vpx: secret "image-registry-tls" not found Jul 08 19:38:51.526976 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:51.526896 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls podName:c80a8750-07c5-4528-b873-81869857a54c nodeName:}" failed. No retries permitted until 2026-07-08 19:38:55.526878769 +0000 UTC m=+257.280522996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls") pod "image-registry-56bfdf68c-v5vpx" (UID: "c80a8750-07c5-4528-b873-81869857a54c") : secret "image-registry-tls" not found Jul 08 19:38:51.527635 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:51.527592 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n" podStartSLOduration=1.638338705 podStartE2EDuration="4.52757557s" totalImagesPullingTime="2.889236865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:38:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:38:51.527170545 +0000 UTC m=+253.280814787" watchObservedRunningTime="2026-07-08 19:38:51.52757557 +0000 UTC m=+253.281219815" Jul 08 19:38:51.627496 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:51.627469 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac461a89-bf5e-4a12-872b-ca3a47602be5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-v9rpc\" (UID: \"ac461a89-bf5e-4a12-872b-ca3a47602be5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc" Jul 08 19:38:51.627634 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:51.627608 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 19:38:51.627692 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:51.627683 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac461a89-bf5e-4a12-872b-ca3a47602be5-samples-operator-tls podName:ac461a89-bf5e-4a12-872b-ca3a47602be5 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:55.627663999 +0000 UTC m=+257.381308218 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac461a89-bf5e-4a12-872b-ca3a47602be5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-v9rpc" (UID: "ac461a89-bf5e-4a12-872b-ca3a47602be5") : secret "samples-operator-tls" not found Jul 08 19:38:52.008889 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.008860 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nj6f6"] Jul 08 19:38:52.011161 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.011140 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:52.016419 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.016394 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 19:38:52.016656 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.016639 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7sx7p\"" Jul 08 19:38:52.016930 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.016913 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 19:38:52.036161 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.036136 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nj6f6"] Jul 08 19:38:52.130757 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.130728 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:52.130906 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.130763 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr2fr\" (UniqueName: \"kubernetes.io/projected/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-api-access-jr2fr\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:52.130906 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.130793 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-crio-socket\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:52.130986 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.130907 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:52.130986 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.130962 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-data-volume\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:52.232077 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.232030 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-crio-socket\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:52.232230 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.232109 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:52.232230 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.232149 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-data-volume\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:52.232230 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.232150 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-crio-socket\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:52.232337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.232244 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:52.232337 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:52.232264 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:38:52.232337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.232279 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr2fr\" (UniqueName: \"kubernetes.io/projected/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-api-access-jr2fr\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:52.232337 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:52.232320 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls podName:5ab8872b-42a7-4ea8-aee7-9cacdce8b974 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:52.732301425 +0000 UTC m=+254.485945645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj6f6" (UID: "5ab8872b-42a7-4ea8-aee7-9cacdce8b974") : secret "insights-runtime-extractor-tls" not found Jul 08 19:38:52.232504 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:52.232365 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:38:52.232504 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:52.232459 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-rbac-proxy-cm podName:5ab8872b-42a7-4ea8-aee7-9cacdce8b974 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:52.732424634 +0000 UTC m=+254.486068854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nj6f6" (UID: "5ab8872b-42a7-4ea8-aee7-9cacdce8b974") : configmap "kube-rbac-proxy" not found Jul 08 19:38:52.232582 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.232519 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-data-volume\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:52.241401 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.241380 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr2fr\" (UniqueName: \"kubernetes.io/projected/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-api-access-jr2fr\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:52.481929 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.481904 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gh46n_9d41e4e9-4418-4797-acea-bca615f11b0f/console-operator/1.log" Jul 08 19:38:52.482375 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.482320 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gh46n_9d41e4e9-4418-4797-acea-bca615f11b0f/console-operator/0.log" Jul 08 19:38:52.482375 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.482351 2553 generic.go:356] "Generic (PLEG): container finished" podID="9d41e4e9-4418-4797-acea-bca615f11b0f" containerID="0eba15de2f686b6e5bdd62a2f005cfb14a2fde2c8a816830b69625d3ad8528e5" exitCode=255 Jul 08 19:38:52.482509 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.482382 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" event={"ID":"9d41e4e9-4418-4797-acea-bca615f11b0f","Type":"ContainerDied","Data":"0eba15de2f686b6e5bdd62a2f005cfb14a2fde2c8a816830b69625d3ad8528e5"} Jul 08 19:38:52.482509 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.482470 2553 scope.go:117] "RemoveContainer" containerID="368637af5f0279e721ea764c63410ede6afb0913682fbffc1014c80d42a53ed3" Jul 08 19:38:52.482646 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.482628 2553 scope.go:117] "RemoveContainer" containerID="0eba15de2f686b6e5bdd62a2f005cfb14a2fde2c8a816830b69625d3ad8528e5" Jul 08 19:38:52.482867 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:52.482833 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-gh46n_openshift-console-operator(9d41e4e9-4418-4797-acea-bca615f11b0f)\"" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" podUID="9d41e4e9-4418-4797-acea-bca615f11b0f" Jul 08 19:38:52.737455 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.737362 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:52.737578 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:52.737465 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:52.737578 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:52.737523 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:38:52.737578 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:52.737534 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:38:52.737675 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:52.737590 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls podName:5ab8872b-42a7-4ea8-aee7-9cacdce8b974 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:53.73757165 +0000 UTC m=+255.491215869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj6f6" (UID: "5ab8872b-42a7-4ea8-aee7-9cacdce8b974") : secret "insights-runtime-extractor-tls" not found Jul 08 19:38:52.737675 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:52.737606 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-rbac-proxy-cm podName:5ab8872b-42a7-4ea8-aee7-9cacdce8b974 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:53.737598463 +0000 UTC m=+255.491242682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nj6f6" (UID: "5ab8872b-42a7-4ea8-aee7-9cacdce8b974") : configmap "kube-rbac-proxy" not found Jul 08 19:38:53.489867 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:53.489841 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gh46n_9d41e4e9-4418-4797-acea-bca615f11b0f/console-operator/1.log" Jul 08 19:38:53.490320 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:53.490132 2553 scope.go:117] "RemoveContainer" containerID="0eba15de2f686b6e5bdd62a2f005cfb14a2fde2c8a816830b69625d3ad8528e5" Jul 08 19:38:53.490320 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:53.490275 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-gh46n_openshift-console-operator(9d41e4e9-4418-4797-acea-bca615f11b0f)\"" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" podUID="9d41e4e9-4418-4797-acea-bca615f11b0f" Jul 08 19:38:53.746049 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:53.745964 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:53.746049 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:53.746016 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:53.746275 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:53.746091 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:38:53.746275 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:53.746124 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:38:53.746275 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:53.746165 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-rbac-proxy-cm podName:5ab8872b-42a7-4ea8-aee7-9cacdce8b974 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:55.746147819 +0000 UTC m=+257.499792037 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nj6f6" (UID: "5ab8872b-42a7-4ea8-aee7-9cacdce8b974") : configmap "kube-rbac-proxy" not found Jul 08 19:38:53.746275 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:53.746189 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls podName:5ab8872b-42a7-4ea8-aee7-9cacdce8b974 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:55.746175627 +0000 UTC m=+257.499819845 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj6f6" (UID: "5ab8872b-42a7-4ea8-aee7-9cacdce8b974") : secret "insights-runtime-extractor-tls" not found Jul 08 19:38:53.746619 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:53.746601 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-krhqb_e507492c-7b39-427a-b189-5317fd33c4f4/dns-node-resolver/0.log" Jul 08 19:38:54.188518 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.188488 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-n92th"] Jul 08 19:38:54.191126 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.191105 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-n92th" Jul 08 19:38:54.194084 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.194053 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 08 19:38:54.194206 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.194055 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 08 19:38:54.194206 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.194054 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 08 19:38:54.194206 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.194103 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 08 19:38:54.195394 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.195375 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-ppkx2\"" Jul 08 19:38:54.202057 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.202035 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-n92th"] Jul 08 19:38:54.249013 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.248989 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/53e9581a-6ff9-415a-a44b-ee701139e260-signing-cabundle\") pod \"service-ca-758f599c5-n92th\" (UID: \"53e9581a-6ff9-415a-a44b-ee701139e260\") " pod="openshift-service-ca/service-ca-758f599c5-n92th" Jul 08 19:38:54.249128 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.249109 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtkvd\" (UniqueName: \"kubernetes.io/projected/53e9581a-6ff9-415a-a44b-ee701139e260-kube-api-access-jtkvd\") pod \"service-ca-758f599c5-n92th\" (UID: \"53e9581a-6ff9-415a-a44b-ee701139e260\") " pod="openshift-service-ca/service-ca-758f599c5-n92th" Jul 08 19:38:54.249199 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.249184 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/53e9581a-6ff9-415a-a44b-ee701139e260-signing-key\") pod \"service-ca-758f599c5-n92th\" (UID: \"53e9581a-6ff9-415a-a44b-ee701139e260\") " pod="openshift-service-ca/service-ca-758f599c5-n92th" Jul 08 19:38:54.350329 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.350302 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtkvd\" (UniqueName: \"kubernetes.io/projected/53e9581a-6ff9-415a-a44b-ee701139e260-kube-api-access-jtkvd\") pod \"service-ca-758f599c5-n92th\" (UID: \"53e9581a-6ff9-415a-a44b-ee701139e260\") " pod="openshift-service-ca/service-ca-758f599c5-n92th" Jul 08 19:38:54.350481 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.350362 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/53e9581a-6ff9-415a-a44b-ee701139e260-signing-key\") pod \"service-ca-758f599c5-n92th\" (UID: \"53e9581a-6ff9-415a-a44b-ee701139e260\") " pod="openshift-service-ca/service-ca-758f599c5-n92th" Jul 08 19:38:54.350481 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.350390 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/53e9581a-6ff9-415a-a44b-ee701139e260-signing-cabundle\") pod \"service-ca-758f599c5-n92th\" (UID: \"53e9581a-6ff9-415a-a44b-ee701139e260\") " pod="openshift-service-ca/service-ca-758f599c5-n92th" Jul 08 19:38:54.350991 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.350968 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/53e9581a-6ff9-415a-a44b-ee701139e260-signing-cabundle\") pod \"service-ca-758f599c5-n92th\" (UID: \"53e9581a-6ff9-415a-a44b-ee701139e260\") " pod="openshift-service-ca/service-ca-758f599c5-n92th" Jul 08 19:38:54.352690 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.352668 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/53e9581a-6ff9-415a-a44b-ee701139e260-signing-key\") pod \"service-ca-758f599c5-n92th\" (UID: \"53e9581a-6ff9-415a-a44b-ee701139e260\") " pod="openshift-service-ca/service-ca-758f599c5-n92th" Jul 08 19:38:54.361463 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.361421 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtkvd\" (UniqueName: \"kubernetes.io/projected/53e9581a-6ff9-415a-a44b-ee701139e260-kube-api-access-jtkvd\") pod \"service-ca-758f599c5-n92th\" (UID: \"53e9581a-6ff9-415a-a44b-ee701139e260\") " pod="openshift-service-ca/service-ca-758f599c5-n92th" Jul 08 19:38:54.500527 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.500461 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-n92th" Jul 08 19:38:54.616135 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:54.616105 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-n92th"] Jul 08 19:38:54.618973 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:38:54.618941 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e9581a_6ff9_415a_a44b_ee701139e260.slice/crio-6ebd0f9f7ecd00aad5848a421c5e39697467fef96cf06262e7806ae2b9cba980 WatchSource:0}: Error finding container 6ebd0f9f7ecd00aad5848a421c5e39697467fef96cf06262e7806ae2b9cba980: Status 404 returned error can't find the container with id 6ebd0f9f7ecd00aad5848a421c5e39697467fef96cf06262e7806ae2b9cba980 Jul 08 19:38:55.152643 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:55.152618 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qgvpz_ee19b31b-83ec-4cfd-9028-53489b1b36e2/node-ca/0.log" Jul 08 19:38:55.497705 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:55.497629 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-n92th" event={"ID":"53e9581a-6ff9-415a-a44b-ee701139e260","Type":"ContainerStarted","Data":"6ebd0f9f7ecd00aad5848a421c5e39697467fef96cf06262e7806ae2b9cba980"} Jul 08 19:38:55.560559 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:55.560518 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:38:55.560942 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:55.560676 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 19:38:55.560942 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:55.560694 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56bfdf68c-v5vpx: secret "image-registry-tls" not found Jul 08 19:38:55.560942 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:55.560744 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls podName:c80a8750-07c5-4528-b873-81869857a54c nodeName:}" failed. No retries permitted until 2026-07-08 19:39:03.560729106 +0000 UTC m=+265.314373325 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls") pod "image-registry-56bfdf68c-v5vpx" (UID: "c80a8750-07c5-4528-b873-81869857a54c") : secret "image-registry-tls" not found Jul 08 19:38:55.661179 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:55.661142 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac461a89-bf5e-4a12-872b-ca3a47602be5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-v9rpc\" (UID: \"ac461a89-bf5e-4a12-872b-ca3a47602be5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc" Jul 08 19:38:55.661339 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:55.661309 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 19:38:55.661399 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:55.661386 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac461a89-bf5e-4a12-872b-ca3a47602be5-samples-operator-tls podName:ac461a89-bf5e-4a12-872b-ca3a47602be5 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:03.661361613 +0000 UTC m=+265.415005831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac461a89-bf5e-4a12-872b-ca3a47602be5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-v9rpc" (UID: "ac461a89-bf5e-4a12-872b-ca3a47602be5") : secret "samples-operator-tls" not found Jul 08 19:38:55.761948 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:55.761859 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:55.761948 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:55.761940 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:55.762151 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:55.761991 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:38:55.762151 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:55.762059 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:38:55.762151 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:55.762063 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-rbac-proxy-cm podName:5ab8872b-42a7-4ea8-aee7-9cacdce8b974 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:59.762044524 +0000 UTC m=+261.515688743 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nj6f6" (UID: "5ab8872b-42a7-4ea8-aee7-9cacdce8b974") : configmap "kube-rbac-proxy" not found Jul 08 19:38:55.762151 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:55.762129 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls podName:5ab8872b-42a7-4ea8-aee7-9cacdce8b974 nodeName:}" failed. No retries permitted until 2026-07-08 19:38:59.762111653 +0000 UTC m=+261.515755876 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj6f6" (UID: "5ab8872b-42a7-4ea8-aee7-9cacdce8b974") : secret "insights-runtime-extractor-tls" not found Jul 08 19:38:55.960851 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:55.960820 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t6lq7_54fc0205-6a28-4930-93e0-f1f37776eaaa/serve-healthcheck-canary/0.log" Jul 08 19:38:57.505619 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:57.505589 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-n92th" event={"ID":"53e9581a-6ff9-415a-a44b-ee701139e260","Type":"ContainerStarted","Data":"7fdd5173421f3945c8ff842b72c9c5e60c6b3640e8beca84758509713a557b63"} Jul 08 19:38:58.225472 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:58.225363 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:38:58.225472 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:58.225455 2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:38:58.225880 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:58.225865 2553 scope.go:117] "RemoveContainer" containerID="0eba15de2f686b6e5bdd62a2f005cfb14a2fde2c8a816830b69625d3ad8528e5" Jul 08 19:38:58.226068 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:58.226043 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-gh46n_openshift-console-operator(9d41e4e9-4418-4797-acea-bca615f11b0f)\"" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" podUID="9d41e4e9-4418-4797-acea-bca615f11b0f" Jul 08 19:38:59.795571 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:59.795537 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:59.795994 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:38:59.795605 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:38:59.795994 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:59.795679 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:38:59.795994 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:59.795745 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls podName:5ab8872b-42a7-4ea8-aee7-9cacdce8b974 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:07.795730571 +0000 UTC m=+269.549374790 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj6f6" (UID: "5ab8872b-42a7-4ea8-aee7-9cacdce8b974") : secret "insights-runtime-extractor-tls" not found Jul 08 19:38:59.795994 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:59.795680 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 19:38:59.795994 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:38:59.795836 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-rbac-proxy-cm podName:5ab8872b-42a7-4ea8-aee7-9cacdce8b974 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:07.795816315 +0000 UTC m=+269.549460535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nj6f6" (UID: "5ab8872b-42a7-4ea8-aee7-9cacdce8b974") : configmap "kube-rbac-proxy" not found Jul 08 19:39:03.623761 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:03.623725 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:39:03.626106 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:03.626074 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls\") pod \"image-registry-56bfdf68c-v5vpx\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:39:03.721950 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:03.721922 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:39:03.724722 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:03.724707 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac461a89-bf5e-4a12-872b-ca3a47602be5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-v9rpc\" (UID: \"ac461a89-bf5e-4a12-872b-ca3a47602be5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc" Jul 08 19:39:03.727030 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:03.727011 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac461a89-bf5e-4a12-872b-ca3a47602be5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-v9rpc\" (UID: \"ac461a89-bf5e-4a12-872b-ca3a47602be5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc" Jul 08 19:39:03.804771 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:03.804741 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc" Jul 08 19:39:03.853798 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:03.853304 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-n92th" podStartSLOduration=7.593441383 podStartE2EDuration="9.853285664s" totalImagesPullingTime="2.259844281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:38:57.528590744 +0000 UTC m=+259.282234986" watchObservedRunningTime="2026-07-08 19:39:03.853285664 +0000 UTC m=+265.606929906" Jul 08 19:39:03.853798 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:03.853602 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56bfdf68c-v5vpx"] Jul 08 19:39:03.855699 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:39:03.855673 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc80a8750_07c5_4528_b873_81869857a54c.slice/crio-5d3a551d12ea6433b4b0322f802996955b2af7aaeeeeef6b6c9b844627798918 WatchSource:0}: Error finding container 5d3a551d12ea6433b4b0322f802996955b2af7aaeeeeef6b6c9b844627798918: Status 404 returned error can't find the container with id 5d3a551d12ea6433b4b0322f802996955b2af7aaeeeeef6b6c9b844627798918 Jul 08 19:39:03.933243 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:03.933210 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc"] Jul 08 19:39:04.528404 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:04.528366 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc" event={"ID":"ac461a89-bf5e-4a12-872b-ca3a47602be5","Type":"ContainerStarted","Data":"758daa78fef86aba016f38e142c95935539975fd4b6c97e56fb6c51f1aa1889e"} Jul 08 19:39:04.529728 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:04.529694 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" event={"ID":"c80a8750-07c5-4528-b873-81869857a54c","Type":"ContainerStarted","Data":"7183f251dd3e1f8450290238d516263ab50221ce66f9664f8e72a5a91a62b5ec"} Jul 08 19:39:04.529817 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:04.529738 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" event={"ID":"c80a8750-07c5-4528-b873-81869857a54c","Type":"ContainerStarted","Data":"5d3a551d12ea6433b4b0322f802996955b2af7aaeeeeef6b6c9b844627798918"} Jul 08 19:39:04.529817 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:04.529782 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:39:04.550581 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:04.550533 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" podStartSLOduration=17.550519809 podStartE2EDuration="17.550519809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:04.550044728 +0000 UTC m=+266.303689008" watchObservedRunningTime="2026-07-08 19:39:04.550519809 +0000 UTC m=+266.304164051" Jul 08 19:39:06.536975 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:06.536936 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc" event={"ID":"ac461a89-bf5e-4a12-872b-ca3a47602be5","Type":"ContainerStarted","Data":"6e31af01ed679cfb140cf3fa0fc3f4df6dc7cc60696ad20b95c8420d855cfe35"} Jul 08 19:39:06.537339 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:06.537007 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc" event={"ID":"ac461a89-bf5e-4a12-872b-ca3a47602be5","Type":"ContainerStarted","Data":"8979db9fed7ccab30a05b33720e79ed1f48930a72c2889ced9d4575542a7fec6"} Jul 08 19:39:06.555219 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:06.555128 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-v9rpc" podStartSLOduration=17.230552394 podStartE2EDuration="19.55511441s" totalImagesPullingTime="2.324562016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:38:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:06.554060615 +0000 UTC m=+268.307704866" watchObservedRunningTime="2026-07-08 19:39:06.55511441 +0000 UTC m=+268.308758650" Jul 08 19:39:07.862151 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:07.862110 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:39:07.862652 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:07.862209 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:39:07.862652 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:39:07.862291 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 19:39:07.862652 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:39:07.862368 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls podName:5ab8872b-42a7-4ea8-aee7-9cacdce8b974 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:23.862349872 +0000 UTC m=+285.615994110 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nj6f6" (UID: "5ab8872b-42a7-4ea8-aee7-9cacdce8b974") : secret "insights-runtime-extractor-tls" not found Jul 08 19:39:07.862847 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:07.862826 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:39:09.772678 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:09.772646 2553 scope.go:117] "RemoveContainer" containerID="0eba15de2f686b6e5bdd62a2f005cfb14a2fde2c8a816830b69625d3ad8528e5" Jul 08 19:39:10.550080 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:10.550053 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gh46n_9d41e4e9-4418-4797-acea-bca615f11b0f/console-operator/2.log" Jul 08 19:39:10.550471 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:10.550456 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gh46n_9d41e4e9-4418-4797-acea-bca615f11b0f/console-operator/1.log" Jul 08 19:39:10.550530 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:10.550487 2553 generic.go:356] "Generic (PLEG): container finished" podID="9d41e4e9-4418-4797-acea-bca615f11b0f" containerID="80e295bc41827ba83b3cb26b9cca68e1712a691ec21bb7385d80e141229c2459" exitCode=255 Jul 08 19:39:10.550571 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:10.550542 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" event={"ID":"9d41e4e9-4418-4797-acea-bca615f11b0f","Type":"ContainerDied","Data":"80e295bc41827ba83b3cb26b9cca68e1712a691ec21bb7385d80e141229c2459"} Jul 08 19:39:10.550609 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:10.550588 2553 scope.go:117] "RemoveContainer" containerID="0eba15de2f686b6e5bdd62a2f005cfb14a2fde2c8a816830b69625d3ad8528e5" Jul 08 19:39:10.550946 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:10.550928 2553 scope.go:117] "RemoveContainer" containerID="80e295bc41827ba83b3cb26b9cca68e1712a691ec21bb7385d80e141229c2459" Jul 08 19:39:10.551099 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:39:10.551080 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-gh46n_openshift-console-operator(9d41e4e9-4418-4797-acea-bca615f11b0f)\"" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" podUID="9d41e4e9-4418-4797-acea-bca615f11b0f" Jul 08 19:39:11.555258 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:11.555229 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gh46n_9d41e4e9-4418-4797-acea-bca615f11b0f/console-operator/2.log" Jul 08 19:39:15.074107 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:15.074070 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56bfdf68c-v5vpx"] Jul 08 19:39:18.225470 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:18.225408 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:39:18.225850 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:18.225519 2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:39:18.225850 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:18.225808 2553 scope.go:117] "RemoveContainer" containerID="80e295bc41827ba83b3cb26b9cca68e1712a691ec21bb7385d80e141229c2459" Jul 08 19:39:18.225967 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:39:18.225948 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-gh46n_openshift-console-operator(9d41e4e9-4418-4797-acea-bca615f11b0f)\"" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" podUID="9d41e4e9-4418-4797-acea-bca615f11b0f" Jul 08 19:39:19.251947 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:39:19.251911 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7wfgs" podUID="6449d116-2ee8-4113-904a-a03e258c4b6b" Jul 08 19:39:19.583517 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:19.583488 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7wfgs" Jul 08 19:39:22.732792 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:22.732758 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6qwwn"] Jul 08 19:39:22.736377 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:22.736360 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6qwwn" Jul 08 19:39:22.738906 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:22.738888 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 08 19:39:22.739013 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:22.738970 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gbghc\"" Jul 08 19:39:22.742683 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:22.742654 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6qwwn"] Jul 08 19:39:22.869216 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:22.869179 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/28b182f8-fa3c-4a5a-8018-ccd6cdf3d058-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6qwwn\" (UID: \"28b182f8-fa3c-4a5a-8018-ccd6cdf3d058\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6qwwn" Jul 08 19:39:22.969767 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:22.969734 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/28b182f8-fa3c-4a5a-8018-ccd6cdf3d058-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6qwwn\" (UID: \"28b182f8-fa3c-4a5a-8018-ccd6cdf3d058\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6qwwn" Jul 08 19:39:22.969917 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:22.969774 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:39:22.972110 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:22.972077 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6449d116-2ee8-4113-904a-a03e258c4b6b-metrics-tls\") pod \"dns-default-7wfgs\" (UID: \"6449d116-2ee8-4113-904a-a03e258c4b6b\") " pod="openshift-dns/dns-default-7wfgs" Jul 08 19:39:22.972211 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:22.972134 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/28b182f8-fa3c-4a5a-8018-ccd6cdf3d058-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6qwwn\" (UID: \"28b182f8-fa3c-4a5a-8018-ccd6cdf3d058\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6qwwn" Jul 08 19:39:23.046251 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:23.046230 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6qwwn" Jul 08 19:39:23.169632 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:23.169609 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6qwwn"] Jul 08 19:39:23.171848 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:39:23.171820 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b182f8_fa3c_4a5a_8018_ccd6cdf3d058.slice/crio-252fb5674d117a0c0cd94c8e2dfa2edb0341fb8acaeceb6e7158a22ace632807 WatchSource:0}: Error finding container 252fb5674d117a0c0cd94c8e2dfa2edb0341fb8acaeceb6e7158a22ace632807: Status 404 returned error can't find the container with id 252fb5674d117a0c0cd94c8e2dfa2edb0341fb8acaeceb6e7158a22ace632807 Jul 08 19:39:23.186512 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:23.186493 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6zdff\"" Jul 08 19:39:23.194529 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:23.194512 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7wfgs" Jul 08 19:39:23.328021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:23.327954 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7wfgs"] Jul 08 19:39:23.330516 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:39:23.330495 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6449d116_2ee8_4113_904a_a03e258c4b6b.slice/crio-dd7cd0e248a074f6edadea856c06004414c02bcc5c5a0ffddb40243051a8a3d8 WatchSource:0}: Error finding container dd7cd0e248a074f6edadea856c06004414c02bcc5c5a0ffddb40243051a8a3d8: Status 404 returned error can't find the container with id dd7cd0e248a074f6edadea856c06004414c02bcc5c5a0ffddb40243051a8a3d8 Jul 08 19:39:23.595832 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:23.595746 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7wfgs" event={"ID":"6449d116-2ee8-4113-904a-a03e258c4b6b","Type":"ContainerStarted","Data":"dd7cd0e248a074f6edadea856c06004414c02bcc5c5a0ffddb40243051a8a3d8"} Jul 08 19:39:23.596740 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:23.596719 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6qwwn" event={"ID":"28b182f8-fa3c-4a5a-8018-ccd6cdf3d058","Type":"ContainerStarted","Data":"252fb5674d117a0c0cd94c8e2dfa2edb0341fb8acaeceb6e7158a22ace632807"} Jul 08 19:39:23.878140 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:23.878056 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:39:23.880416 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:23.880389 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5ab8872b-42a7-4ea8-aee7-9cacdce8b974-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nj6f6\" (UID: \"5ab8872b-42a7-4ea8-aee7-9cacdce8b974\") " pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:39:24.119503 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:24.119468 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nj6f6" Jul 08 19:39:24.267532 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:24.267457 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nj6f6"] Jul 08 19:39:24.270994 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:39:24.270963 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ab8872b_42a7_4ea8_aee7_9cacdce8b974.slice/crio-aaa0f72d4842e8e4e881344ee5be6abee900dd4c81575d96e1ed9712d041ebb9 WatchSource:0}: Error finding container aaa0f72d4842e8e4e881344ee5be6abee900dd4c81575d96e1ed9712d041ebb9: Status 404 returned error can't find the container with id aaa0f72d4842e8e4e881344ee5be6abee900dd4c81575d96e1ed9712d041ebb9 Jul 08 19:39:24.601573 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:24.601534 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj6f6" event={"ID":"5ab8872b-42a7-4ea8-aee7-9cacdce8b974","Type":"ContainerStarted","Data":"aaa0f72d4842e8e4e881344ee5be6abee900dd4c81575d96e1ed9712d041ebb9"} Jul 08 19:39:25.082086 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.081777 2553 patch_prober.go:28] interesting pod/image-registry-56bfdf68c-v5vpx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 19:39:25.082086 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.081838 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" podUID="c80a8750-07c5-4528-b873-81869857a54c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 19:39:25.607996 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.607957 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6qwwn" event={"ID":"28b182f8-fa3c-4a5a-8018-ccd6cdf3d058","Type":"ContainerStarted","Data":"b27db24c5f116fdb458399b0559f930fb30d1f55899c7b2448c7f9ab27edefa1"} Jul 08 19:39:25.608949 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.608928 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6qwwn" Jul 08 19:39:25.612458 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.612389 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7wfgs" event={"ID":"6449d116-2ee8-4113-904a-a03e258c4b6b","Type":"ContainerStarted","Data":"2063c6726c6a2c602e23962013bed765edd94aa0fda2dca8bc6266ff2618dfbf"} Jul 08 19:39:25.612616 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.612575 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7wfgs" event={"ID":"6449d116-2ee8-4113-904a-a03e258c4b6b","Type":"ContainerStarted","Data":"97ee631ad04b671750ecdb2d724b77b15c8a133e2de4d86a4eb5c978a0c36358"} Jul 08 19:39:25.612749 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.612715 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7wfgs" Jul 08 19:39:25.615535 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.615480 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6qwwn" Jul 08 19:39:25.624322 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.623501 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6qwwn" podStartSLOduration=1.7999646889999998 podStartE2EDuration="3.623483946s" totalImagesPullingTime="1.823519257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:25.622746088 +0000 UTC m=+287.376390345" watchObservedRunningTime="2026-07-08 19:39:25.623483946 +0000 UTC m=+287.377128188" Jul 08 19:39:25.656097 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.655703 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7wfgs" podStartSLOduration=250.985986373 podStartE2EDuration="4m12.655660752s" totalImagesPullingTime="1.669674379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:25.655133716 +0000 UTC m=+287.408777982" watchObservedRunningTime="2026-07-08 19:39:25.655660752 +0000 UTC m=+287.409304995" Jul 08 19:39:25.792090 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.792058 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb"] Jul 08 19:39:25.794405 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.794384 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" Jul 08 19:39:25.797555 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.797381 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 08 19:39:25.797555 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.797406 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 08 19:39:25.797555 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.797419 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 19:39:25.797814 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.797583 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 19:39:25.797814 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.797587 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 19:39:25.797814 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.797645 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-f6mfm\"" Jul 08 19:39:25.806309 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.806250 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb"] Jul 08 19:39:25.893459 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.893360 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9e1337a-4870-492b-a157-98c8aee258e9-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-dtwgb\" (UID: \"d9e1337a-4870-492b-a157-98c8aee258e9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" Jul 08 19:39:25.893459 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.893404 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9e1337a-4870-492b-a157-98c8aee258e9-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-dtwgb\" (UID: \"d9e1337a-4870-492b-a157-98c8aee258e9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" Jul 08 19:39:25.893676 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.893480 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9e1337a-4870-492b-a157-98c8aee258e9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-dtwgb\" (UID: \"d9e1337a-4870-492b-a157-98c8aee258e9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" Jul 08 19:39:25.893676 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.893556 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzrpg\" (UniqueName: \"kubernetes.io/projected/d9e1337a-4870-492b-a157-98c8aee258e9-kube-api-access-jzrpg\") pod \"prometheus-operator-567f7b8b7c-dtwgb\" (UID: \"d9e1337a-4870-492b-a157-98c8aee258e9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" Jul 08 19:39:25.994605 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.994565 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzrpg\" (UniqueName: \"kubernetes.io/projected/d9e1337a-4870-492b-a157-98c8aee258e9-kube-api-access-jzrpg\") pod \"prometheus-operator-567f7b8b7c-dtwgb\" (UID: \"d9e1337a-4870-492b-a157-98c8aee258e9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" Jul 08 19:39:25.994781 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.994678 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9e1337a-4870-492b-a157-98c8aee258e9-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-dtwgb\" (UID: \"d9e1337a-4870-492b-a157-98c8aee258e9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" Jul 08 19:39:25.994781 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.994721 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9e1337a-4870-492b-a157-98c8aee258e9-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-dtwgb\" (UID: \"d9e1337a-4870-492b-a157-98c8aee258e9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" Jul 08 19:39:25.994781 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.994772 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9e1337a-4870-492b-a157-98c8aee258e9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-dtwgb\" (UID: \"d9e1337a-4870-492b-a157-98c8aee258e9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" Jul 08 19:39:25.994945 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:39:25.994856 2553 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 08 19:39:25.994945 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:39:25.994917 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9e1337a-4870-492b-a157-98c8aee258e9-prometheus-operator-tls podName:d9e1337a-4870-492b-a157-98c8aee258e9 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:26.494897126 +0000 UTC m=+288.248541346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/d9e1337a-4870-492b-a157-98c8aee258e9-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-dtwgb" (UID: "d9e1337a-4870-492b-a157-98c8aee258e9") : secret "prometheus-operator-tls" not found Jul 08 19:39:25.995583 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.995538 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9e1337a-4870-492b-a157-98c8aee258e9-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-dtwgb\" (UID: \"d9e1337a-4870-492b-a157-98c8aee258e9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" Jul 08 19:39:25.997599 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:25.997577 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9e1337a-4870-492b-a157-98c8aee258e9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-dtwgb\" (UID: \"d9e1337a-4870-492b-a157-98c8aee258e9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" Jul 08 19:39:26.004093 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:26.004047 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzrpg\" (UniqueName: \"kubernetes.io/projected/d9e1337a-4870-492b-a157-98c8aee258e9-kube-api-access-jzrpg\") pod \"prometheus-operator-567f7b8b7c-dtwgb\" (UID: \"d9e1337a-4870-492b-a157-98c8aee258e9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" Jul 08 19:39:26.498807 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:26.498762 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9e1337a-4870-492b-a157-98c8aee258e9-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-dtwgb\" (UID: \"d9e1337a-4870-492b-a157-98c8aee258e9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" Jul 08 19:39:26.501399 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:26.501372 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9e1337a-4870-492b-a157-98c8aee258e9-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-dtwgb\" (UID: \"d9e1337a-4870-492b-a157-98c8aee258e9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" Jul 08 19:39:26.705588 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:26.705560 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" Jul 08 19:39:28.476473 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:28.476446 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb"] Jul 08 19:39:28.478534 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:39:28.478507 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e1337a_4870_492b_a157_98c8aee258e9.slice/crio-16ed2cc136be840e595035fd21cc58b6c5e6f8e9c644ff40ad71de0e026eed99 WatchSource:0}: Error finding container 16ed2cc136be840e595035fd21cc58b6c5e6f8e9c644ff40ad71de0e026eed99: Status 404 returned error can't find the container with id 16ed2cc136be840e595035fd21cc58b6c5e6f8e9c644ff40ad71de0e026eed99 Jul 08 19:39:28.624044 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:28.623965 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj6f6" event={"ID":"5ab8872b-42a7-4ea8-aee7-9cacdce8b974","Type":"ContainerStarted","Data":"f557a43c1c848148a207770ab44ea16a65ee7db35099e5fd5586c924ecebbc65"} Jul 08 19:39:28.625042 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:28.625019 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" event={"ID":"d9e1337a-4870-492b-a157-98c8aee258e9","Type":"ContainerStarted","Data":"16ed2cc136be840e595035fd21cc58b6c5e6f8e9c644ff40ad71de0e026eed99"} Jul 08 19:39:29.630343 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:29.630310 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj6f6" event={"ID":"5ab8872b-42a7-4ea8-aee7-9cacdce8b974","Type":"ContainerStarted","Data":"621cb247dca358c7b7e1f5cdc45ea3a65e4a37875f358019bba531c5f7cd5857"} Jul 08 19:39:30.636706 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:30.636668 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" event={"ID":"d9e1337a-4870-492b-a157-98c8aee258e9","Type":"ContainerStarted","Data":"01da4f74f525eaa8e7e1fd37ade154976ea3f26f08ec4280dbaf5a37dfd1a5aa"} Jul 08 19:39:30.637170 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:30.636735 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" event={"ID":"d9e1337a-4870-492b-a157-98c8aee258e9","Type":"ContainerStarted","Data":"fbbee8befe7cdf5aaafc813817a2f4d07143b7c8a8e2b29b27a4b98838cd4dd3"} Jul 08 19:39:30.652938 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:30.652890 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-dtwgb" podStartSLOduration=3.927951815 podStartE2EDuration="5.652873115s" totalImagesPullingTime="1.7249213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:30.652132543 +0000 UTC m=+292.405776785" watchObservedRunningTime="2026-07-08 19:39:30.652873115 +0000 UTC m=+292.406517356" Jul 08 19:39:30.773383 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:30.773356 2553 scope.go:117] "RemoveContainer" containerID="80e295bc41827ba83b3cb26b9cca68e1712a691ec21bb7385d80e141229c2459" Jul 08 19:39:32.164553 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.164474 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8"] Jul 08 19:39:32.167844 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.167824 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.169708 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.169679 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ll4dk"] Jul 08 19:39:32.172898 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.172877 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-tx7k8\"" Jul 08 19:39:32.173313 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.173295 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.174499 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.174148 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 08 19:39:32.174499 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.174175 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 08 19:39:32.174499 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.174401 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 08 19:39:32.177355 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.177236 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 19:39:32.177753 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.177730 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z4lrr\"" Jul 08 19:39:32.177925 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.177912 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 19:39:32.178097 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.178084 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 19:39:32.183182 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.183156 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8"] Jul 08 19:39:32.240498 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.240468 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5a21740-6f8c-469f-a810-0ec194db1d62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.240689 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.240516 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-node-exporter-tls\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.240689 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.240548 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fgch\" (UniqueName: \"kubernetes.io/projected/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-kube-api-access-8fgch\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.240689 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.240582 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmmkv\" (UniqueName: \"kubernetes.io/projected/a5a21740-6f8c-469f-a810-0ec194db1d62-kube-api-access-rmmkv\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.240689 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.240605 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-node-exporter-wtmp\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.240689 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.240668 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5a21740-6f8c-469f-a810-0ec194db1d62-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.240874 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.240706 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.240874 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.240768 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-metrics-client-ca\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.240874 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.240794 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-root\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.240874 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.240818 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-node-exporter-accelerators-collector-config\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.241033 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.240867 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a5a21740-6f8c-469f-a810-0ec194db1d62-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.241033 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.240930 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-node-exporter-textfile\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.241033 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.240958 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5a21740-6f8c-469f-a810-0ec194db1d62-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.241033 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.240985 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-sys\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.241033 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.241015 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a5a21740-6f8c-469f-a810-0ec194db1d62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.342138 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.342105 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmmkv\" (UniqueName: \"kubernetes.io/projected/a5a21740-6f8c-469f-a810-0ec194db1d62-kube-api-access-rmmkv\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.342138 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.342141 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-node-exporter-wtmp\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.342366 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.342159 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5a21740-6f8c-469f-a810-0ec194db1d62-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.342366 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.342282 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-node-exporter-wtmp\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.342366 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.342291 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.342366 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:39:32.342351 2553 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 08 19:39:32.342366 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.342359 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-metrics-client-ca\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.342632 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.342391 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-root\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.342632 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.342419 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-node-exporter-accelerators-collector-config\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.342632 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:39:32.342456 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5a21740-6f8c-469f-a810-0ec194db1d62-kube-state-metrics-tls podName:a5a21740-6f8c-469f-a810-0ec194db1d62 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:32.842413355 +0000 UTC m=+294.596057595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a5a21740-6f8c-469f-a810-0ec194db1d62-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-xbkp8" (UID: "a5a21740-6f8c-469f-a810-0ec194db1d62") : secret "kube-state-metrics-tls" not found Jul 08 19:39:32.342632 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.342493 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a5a21740-6f8c-469f-a810-0ec194db1d62-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.342632 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.342544 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-node-exporter-textfile\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.342632 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.342575 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5a21740-6f8c-469f-a810-0ec194db1d62-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.342632 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.342607 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-sys\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.342965 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.342642 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a5a21740-6f8c-469f-a810-0ec194db1d62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.342965 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.342688 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5a21740-6f8c-469f-a810-0ec194db1d62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.342965 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.342727 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-node-exporter-tls\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.342965 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.342751 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fgch\" (UniqueName: \"kubernetes.io/projected/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-kube-api-access-8fgch\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.342965 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.342806 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-root\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.342965 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.342828 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-sys\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.342965 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:39:32.342904 2553 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 19:39:32.342965 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:39:32.342948 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-node-exporter-tls podName:5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3 nodeName:}" failed. No retries permitted until 2026-07-08 19:39:32.842933376 +0000 UTC m=+294.596577596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-node-exporter-tls") pod "node-exporter-ll4dk" (UID: "5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3") : secret "node-exporter-tls" not found Jul 08 19:39:32.343350 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.343077 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-metrics-client-ca\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.343498 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.343474 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5a21740-6f8c-469f-a810-0ec194db1d62-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.343861 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.343843 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a5a21740-6f8c-469f-a810-0ec194db1d62-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.343959 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.343874 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-node-exporter-textfile\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.344182 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.344161 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-node-exporter-accelerators-collector-config\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.344240 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.344183 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a5a21740-6f8c-469f-a810-0ec194db1d62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.345476 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.345451 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.345557 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.345535 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5a21740-6f8c-469f-a810-0ec194db1d62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.350202 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.350176 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmmkv\" (UniqueName: \"kubernetes.io/projected/a5a21740-6f8c-469f-a810-0ec194db1d62-kube-api-access-rmmkv\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.351268 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.351249 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fgch\" (UniqueName: \"kubernetes.io/projected/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-kube-api-access-8fgch\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.603369 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.603331 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-gbdvb"] Jul 08 19:39:32.608095 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.608075 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-gbdvb" Jul 08 19:39:32.610474 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.610449 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fmdjw\"" Jul 08 19:39:32.610602 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.610490 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 19:39:32.610602 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.610510 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 19:39:32.616715 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.616683 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-gbdvb"] Jul 08 19:39:32.645489 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.645467 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrpmf\" (UniqueName: \"kubernetes.io/projected/62792e1e-c855-4450-9429-84cc68c896c9-kube-api-access-wrpmf\") pod \"downloads-685bfb5f64-gbdvb\" (UID: \"62792e1e-c855-4450-9429-84cc68c896c9\") " pod="openshift-console/downloads-685bfb5f64-gbdvb" Jul 08 19:39:32.647624 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.647598 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nj6f6" event={"ID":"5ab8872b-42a7-4ea8-aee7-9cacdce8b974","Type":"ContainerStarted","Data":"bf68cf04f6d12092d31b9ea98b931d8c127f97f376cd79a812e16ad17326aac3"} Jul 08 19:39:32.649473 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.649457 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gh46n_9d41e4e9-4418-4797-acea-bca615f11b0f/console-operator/2.log" Jul 08 19:39:32.649561 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.649508 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" event={"ID":"9d41e4e9-4418-4797-acea-bca615f11b0f","Type":"ContainerStarted","Data":"096071771bed24c20b0ed9733fd2957230198ef151706efe1fb0aaee5c930936"} Jul 08 19:39:32.649756 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.649741 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:39:32.654352 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.654316 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" Jul 08 19:39:32.669466 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.669410 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nj6f6" podStartSLOduration=34.212372042 podStartE2EDuration="41.669397485s" totalImagesPullingTime="7.457025443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:38:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:32.668966602 +0000 UTC m=+294.422610846" watchObservedRunningTime="2026-07-08 19:39:32.669397485 +0000 UTC m=+294.423041726" Jul 08 19:39:32.686668 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.686620 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-gh46n" podStartSLOduration=42.819247258 podStartE2EDuration="45.686603652s" totalImagesPullingTime="2.867356394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:38:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:32.685802343 +0000 UTC m=+294.439446597" watchObservedRunningTime="2026-07-08 19:39:32.686603652 +0000 UTC m=+294.440247895" Jul 08 19:39:32.746336 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.746289 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrpmf\" (UniqueName: \"kubernetes.io/projected/62792e1e-c855-4450-9429-84cc68c896c9-kube-api-access-wrpmf\") pod \"downloads-685bfb5f64-gbdvb\" (UID: \"62792e1e-c855-4450-9429-84cc68c896c9\") " pod="openshift-console/downloads-685bfb5f64-gbdvb" Jul 08 19:39:32.755364 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.755340 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrpmf\" (UniqueName: \"kubernetes.io/projected/62792e1e-c855-4450-9429-84cc68c896c9-kube-api-access-wrpmf\") pod \"downloads-685bfb5f64-gbdvb\" (UID: \"62792e1e-c855-4450-9429-84cc68c896c9\") " pod="openshift-console/downloads-685bfb5f64-gbdvb" Jul 08 19:39:32.773408 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:39:32.773377 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4n4kl" podUID="df97169f-20ad-4b99-b6c8-9cec807f0296" Jul 08 19:39:32.846933 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.846909 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-node-exporter-tls\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.847042 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.846953 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5a21740-6f8c-469f-a810-0ec194db1d62-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.849257 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.849228 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5a21740-6f8c-469f-a810-0ec194db1d62-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-xbkp8\" (UID: \"a5a21740-6f8c-469f-a810-0ec194db1d62\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:32.849331 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.849256 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3-node-exporter-tls\") pod \"node-exporter-ll4dk\" (UID: \"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3\") " pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:32.919272 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:32.919215 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-gbdvb" Jul 08 19:39:33.044601 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:33.044563 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-gbdvb"] Jul 08 19:39:33.047509 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:39:33.047480 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62792e1e_c855_4450_9429_84cc68c896c9.slice/crio-22b9429026923b24dc73466e383f3e756084f02a314e7a0e133f82e3bc66838e WatchSource:0}: Error finding container 22b9429026923b24dc73466e383f3e756084f02a314e7a0e133f82e3bc66838e: Status 404 returned error can't find the container with id 22b9429026923b24dc73466e383f3e756084f02a314e7a0e133f82e3bc66838e Jul 08 19:39:33.081709 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:33.081683 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" Jul 08 19:39:33.087870 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:33.087854 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ll4dk" Jul 08 19:39:33.100611 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:39:33.100579 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c27fd7f_fee9_473d_87d4_e5dbe7f00ff3.slice/crio-986b72b0109366ffe77e9b94eff6dd5afde8f8e48ceb67db8f1f7476b511a17b WatchSource:0}: Error finding container 986b72b0109366ffe77e9b94eff6dd5afde8f8e48ceb67db8f1f7476b511a17b: Status 404 returned error can't find the container with id 986b72b0109366ffe77e9b94eff6dd5afde8f8e48ceb67db8f1f7476b511a17b Jul 08 19:39:33.216280 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:33.216254 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8"] Jul 08 19:39:33.218094 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:39:33.218042 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a21740_6f8c_469f_a810_0ec194db1d62.slice/crio-453e4c7f058bd0537b53ffd82fd1f92074feee91d6b6e5f1658e8be865e4b3d5 WatchSource:0}: Error finding container 453e4c7f058bd0537b53ffd82fd1f92074feee91d6b6e5f1658e8be865e4b3d5: Status 404 returned error can't find the container with id 453e4c7f058bd0537b53ffd82fd1f92074feee91d6b6e5f1658e8be865e4b3d5 Jul 08 19:39:33.653612 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:33.653573 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" event={"ID":"a5a21740-6f8c-469f-a810-0ec194db1d62","Type":"ContainerStarted","Data":"453e4c7f058bd0537b53ffd82fd1f92074feee91d6b6e5f1658e8be865e4b3d5"} Jul 08 19:39:33.655060 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:33.654982 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-gbdvb" event={"ID":"62792e1e-c855-4450-9429-84cc68c896c9","Type":"ContainerStarted","Data":"22b9429026923b24dc73466e383f3e756084f02a314e7a0e133f82e3bc66838e"} Jul 08 19:39:33.656166 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:33.656145 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ll4dk" event={"ID":"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3","Type":"ContainerStarted","Data":"986b72b0109366ffe77e9b94eff6dd5afde8f8e48ceb67db8f1f7476b511a17b"} Jul 08 19:39:34.662423 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:34.662388 2553 generic.go:356] "Generic (PLEG): container finished" podID="5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3" containerID="c9602471286d1b26352c06ae11c731b8befbdc522c97542dc09468dc1cdc1c5f" exitCode=0 Jul 08 19:39:34.662856 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:34.662531 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ll4dk" event={"ID":"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3","Type":"ContainerDied","Data":"c9602471286d1b26352c06ae11c731b8befbdc522c97542dc09468dc1cdc1c5f"} Jul 08 19:39:35.080694 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:35.080466 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:39:35.619320 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:35.618519 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7wfgs" Jul 08 19:39:35.678191 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:35.678157 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" event={"ID":"a5a21740-6f8c-469f-a810-0ec194db1d62","Type":"ContainerStarted","Data":"a3533a61a9933d9f075506101e91dcef5d47189df15be9122972e06fca0ea5f6"} Jul 08 19:39:35.678643 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:35.678329 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" event={"ID":"a5a21740-6f8c-469f-a810-0ec194db1d62","Type":"ContainerStarted","Data":"6559518fcd6bdbd70ceb69aac13136df26272bf7693ff643cef90dc71bd14f83"} Jul 08 19:39:35.678643 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:35.678397 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" event={"ID":"a5a21740-6f8c-469f-a810-0ec194db1d62","Type":"ContainerStarted","Data":"dd999385d54e304708004fca0e40418f1b37b5ff84e603a3df91d04f8d8d0dfd"} Jul 08 19:39:35.681407 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:35.681148 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ll4dk" event={"ID":"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3","Type":"ContainerStarted","Data":"f040e6e8f6fe5c3be10ba15bb5bf684db8aedf54b088aa70ea34191c421a71d5"} Jul 08 19:39:35.681407 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:35.681188 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ll4dk" event={"ID":"5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3","Type":"ContainerStarted","Data":"9f0fa38d2685fc75771f11ca65c71362238cbf1a48f3a3812aef85bdac5e6022"} Jul 08 19:39:35.696597 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:35.696548 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-xbkp8" podStartSLOduration=1.65450132 podStartE2EDuration="3.696531225s" totalImagesPullingTime="2.042029905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:35.695293585 +0000 UTC m=+297.448937849" watchObservedRunningTime="2026-07-08 19:39:35.696531225 +0000 UTC m=+297.450175467" Jul 08 19:39:35.715096 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:35.715049 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ll4dk" podStartSLOduration=2.299241378 podStartE2EDuration="3.715030978s" totalImagesPullingTime="1.328211312s" totalInitContainerRuntime="87.578288ms" isStatefulPod=true podCreationTimestamp="2026-07-08 19:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:35.713079322 +0000 UTC m=+297.466723638" watchObservedRunningTime="2026-07-08 19:39:35.715030978 +0000 UTC m=+297.468675220" Jul 08 19:39:36.556367 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.556330 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-55cc7b7d9f-7svmw"] Jul 08 19:39:36.559709 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.559689 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.563504 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.563479 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 08 19:39:36.563613 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.563508 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 19:39:36.563613 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.563539 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 08 19:39:36.563613 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.563566 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3hhjoncccvmca\"" Jul 08 19:39:36.563782 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.563767 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 08 19:39:36.563876 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.563854 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-4sjmq\"" Jul 08 19:39:36.571958 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.571935 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55cc7b7d9f-7svmw"] Jul 08 19:39:36.581720 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.581695 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/764a6522-bd60-4373-a26e-fe67898f342f-secret-metrics-server-client-certs\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.581813 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.581737 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftdg7\" (UniqueName: \"kubernetes.io/projected/764a6522-bd60-4373-a26e-fe67898f342f-kube-api-access-ftdg7\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.581813 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.581789 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/764a6522-bd60-4373-a26e-fe67898f342f-secret-metrics-server-tls\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.581901 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.581871 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/764a6522-bd60-4373-a26e-fe67898f342f-metrics-server-audit-profiles\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.581947 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.581905 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/764a6522-bd60-4373-a26e-fe67898f342f-audit-log\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.581995 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.581978 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/764a6522-bd60-4373-a26e-fe67898f342f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.582068 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.582051 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/764a6522-bd60-4373-a26e-fe67898f342f-client-ca-bundle\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.682776 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.682747 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/764a6522-bd60-4373-a26e-fe67898f342f-secret-metrics-server-tls\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.683242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.682791 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/764a6522-bd60-4373-a26e-fe67898f342f-metrics-server-audit-profiles\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.683242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.682818 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/764a6522-bd60-4373-a26e-fe67898f342f-audit-log\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.683242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.682868 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/764a6522-bd60-4373-a26e-fe67898f342f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.683242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.682913 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/764a6522-bd60-4373-a26e-fe67898f342f-client-ca-bundle\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.683242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.682959 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/764a6522-bd60-4373-a26e-fe67898f342f-secret-metrics-server-client-certs\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.683242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.682997 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftdg7\" (UniqueName: \"kubernetes.io/projected/764a6522-bd60-4373-a26e-fe67898f342f-kube-api-access-ftdg7\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.683585 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.683499 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/764a6522-bd60-4373-a26e-fe67898f342f-audit-log\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.683968 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.683943 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/764a6522-bd60-4373-a26e-fe67898f342f-metrics-server-audit-profiles\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.684100 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.684066 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/764a6522-bd60-4373-a26e-fe67898f342f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.685944 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.685916 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/764a6522-bd60-4373-a26e-fe67898f342f-secret-metrics-server-client-certs\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.686037 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.686015 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/764a6522-bd60-4373-a26e-fe67898f342f-secret-metrics-server-tls\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.686384 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.686360 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/764a6522-bd60-4373-a26e-fe67898f342f-client-ca-bundle\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.692330 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.692286 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftdg7\" (UniqueName: \"kubernetes.io/projected/764a6522-bd60-4373-a26e-fe67898f342f-kube-api-access-ftdg7\") pod \"metrics-server-55cc7b7d9f-7svmw\" (UID: \"764a6522-bd60-4373-a26e-fe67898f342f\") " pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:36.869962 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:36.869882 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:37.036503 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.036475 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55cc7b7d9f-7svmw"] Jul 08 19:39:37.039317 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:39:37.039287 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod764a6522_bd60_4373_a26e_fe67898f342f.slice/crio-549d59708d8123a114dbee9e863b3df7283ceac3133617e550c0d195ba95a729 WatchSource:0}: Error finding container 549d59708d8123a114dbee9e863b3df7283ceac3133617e550c0d195ba95a729: Status 404 returned error can't find the container with id 549d59708d8123a114dbee9e863b3df7283ceac3133617e550c0d195ba95a729 Jul 08 19:39:37.427332 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.427301 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk"] Jul 08 19:39:37.432115 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.432094 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.438093 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.435325 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 08 19:39:37.438093 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.435628 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 08 19:39:37.438093 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.435844 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 08 19:39:37.438634 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.438554 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 08 19:39:37.438731 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.438722 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 08 19:39:37.438798 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.438759 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-54d7k\"" Jul 08 19:39:37.442563 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.442540 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 08 19:39:37.456797 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.456774 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk"] Jul 08 19:39:37.492548 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.492519 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd45707c-fe85-47f1-89d5-23bbba53f2d4-metrics-client-ca\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.492670 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.492561 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd45707c-fe85-47f1-89d5-23bbba53f2d4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.492670 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.492584 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dd45707c-fe85-47f1-89d5-23bbba53f2d4-telemeter-client-tls\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.492670 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.492609 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd45707c-fe85-47f1-89d5-23bbba53f2d4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.492834 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.492665 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lc75\" (UniqueName: \"kubernetes.io/projected/dd45707c-fe85-47f1-89d5-23bbba53f2d4-kube-api-access-4lc75\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.492834 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.492729 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd45707c-fe85-47f1-89d5-23bbba53f2d4-serving-certs-ca-bundle\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.492834 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.492768 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dd45707c-fe85-47f1-89d5-23bbba53f2d4-federate-client-tls\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.492834 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.492797 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dd45707c-fe85-47f1-89d5-23bbba53f2d4-secret-telemeter-client\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.594323 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.594288 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd45707c-fe85-47f1-89d5-23bbba53f2d4-metrics-client-ca\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.594516 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.594343 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd45707c-fe85-47f1-89d5-23bbba53f2d4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.594516 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.594376 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dd45707c-fe85-47f1-89d5-23bbba53f2d4-telemeter-client-tls\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.594516 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.594402 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd45707c-fe85-47f1-89d5-23bbba53f2d4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.594516 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.594431 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lc75\" (UniqueName: \"kubernetes.io/projected/dd45707c-fe85-47f1-89d5-23bbba53f2d4-kube-api-access-4lc75\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.594516 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.594487 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd45707c-fe85-47f1-89d5-23bbba53f2d4-serving-certs-ca-bundle\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.594760 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.594535 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dd45707c-fe85-47f1-89d5-23bbba53f2d4-federate-client-tls\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.594808 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.594756 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dd45707c-fe85-47f1-89d5-23bbba53f2d4-secret-telemeter-client\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.595356 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.595321 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd45707c-fe85-47f1-89d5-23bbba53f2d4-serving-certs-ca-bundle\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.595533 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.595504 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd45707c-fe85-47f1-89d5-23bbba53f2d4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.595784 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.595735 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd45707c-fe85-47f1-89d5-23bbba53f2d4-metrics-client-ca\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.597744 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.597721 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/dd45707c-fe85-47f1-89d5-23bbba53f2d4-federate-client-tls\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.597998 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.597980 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd45707c-fe85-47f1-89d5-23bbba53f2d4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.598043 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.598020 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/dd45707c-fe85-47f1-89d5-23bbba53f2d4-secret-telemeter-client\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.598086 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.598024 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/dd45707c-fe85-47f1-89d5-23bbba53f2d4-telemeter-client-tls\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.603581 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.603562 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lc75\" (UniqueName: \"kubernetes.io/projected/dd45707c-fe85-47f1-89d5-23bbba53f2d4-kube-api-access-4lc75\") pod \"telemeter-client-775f7b5cf6-mkjgk\" (UID: \"dd45707c-fe85-47f1-89d5-23bbba53f2d4\") " pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.691751 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.691672 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" event={"ID":"764a6522-bd60-4373-a26e-fe67898f342f","Type":"ContainerStarted","Data":"549d59708d8123a114dbee9e863b3df7283ceac3133617e550c0d195ba95a729"} Jul 08 19:39:37.748203 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.748169 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" Jul 08 19:39:37.905192 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:37.905160 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk"] Jul 08 19:39:37.909323 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:39:37.909297 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd45707c_fe85_47f1_89d5_23bbba53f2d4.slice/crio-98963699886d33a0555e232173812c1eb6e6afa938c8752281a0757c74a9501f WatchSource:0}: Error finding container 98963699886d33a0555e232173812c1eb6e6afa938c8752281a0757c74a9501f: Status 404 returned error can't find the container with id 98963699886d33a0555e232173812c1eb6e6afa938c8752281a0757c74a9501f Jul 08 19:39:38.644918 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:38.644860 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gh46n_9d41e4e9-4418-4797-acea-bca615f11b0f/console-operator/2.log" Jul 08 19:39:38.647239 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:38.645898 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gh46n_9d41e4e9-4418-4797-acea-bca615f11b0f/console-operator/2.log" Jul 08 19:39:38.667768 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:38.667746 2553 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 19:39:38.699396 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:38.699359 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" event={"ID":"dd45707c-fe85-47f1-89d5-23bbba53f2d4","Type":"ContainerStarted","Data":"98963699886d33a0555e232173812c1eb6e6afa938c8752281a0757c74a9501f"} Jul 08 19:39:39.706314 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:39.706204 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" event={"ID":"764a6522-bd60-4373-a26e-fe67898f342f","Type":"ContainerStarted","Data":"dbe0e691e45114e90b170e634645a5445352eba2ed1d86de32e5dcfd21ad4f5e"} Jul 08 19:39:39.725387 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:39.725337 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" podStartSLOduration=1.319337016 podStartE2EDuration="3.725316465s" totalImagesPullingTime="2.405979449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:39:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:39.722692191 +0000 UTC m=+301.476336465" watchObservedRunningTime="2026-07-08 19:39:39.725316465 +0000 UTC m=+301.478960710" Jul 08 19:39:40.093832 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.093764 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" podUID="c80a8750-07c5-4528-b873-81869857a54c" containerName="registry" containerID="cri-o://7183f251dd3e1f8450290238d516263ab50221ce66f9664f8e72a5a91a62b5ec" gracePeriod=30 Jul 08 19:39:40.545465 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.544907 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:39:40.592963 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.592897 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:39:40.627677 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.627589 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c80a8750-07c5-4528-b873-81869857a54c-image-registry-private-configuration\") pod \"c80a8750-07c5-4528-b873-81869857a54c\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " Jul 08 19:39:40.627677 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.627629 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c80a8750-07c5-4528-b873-81869857a54c-trusted-ca\") pod \"c80a8750-07c5-4528-b873-81869857a54c\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " Jul 08 19:39:40.627677 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.627663 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls\") pod \"c80a8750-07c5-4528-b873-81869857a54c\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " Jul 08 19:39:40.627915 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.627689 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c80a8750-07c5-4528-b873-81869857a54c-installation-pull-secrets\") pod \"c80a8750-07c5-4528-b873-81869857a54c\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " Jul 08 19:39:40.627915 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.627714 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcdg8\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-kube-api-access-tcdg8\") pod \"c80a8750-07c5-4528-b873-81869857a54c\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " Jul 08 19:39:40.627915 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.627741 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c80a8750-07c5-4528-b873-81869857a54c-registry-certificates\") pod \"c80a8750-07c5-4528-b873-81869857a54c\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " Jul 08 19:39:40.627915 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.627829 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c80a8750-07c5-4528-b873-81869857a54c-ca-trust-extracted\") pod \"c80a8750-07c5-4528-b873-81869857a54c\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " Jul 08 19:39:40.627915 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.627863 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-bound-sa-token\") pod \"c80a8750-07c5-4528-b873-81869857a54c\" (UID: \"c80a8750-07c5-4528-b873-81869857a54c\") " Jul 08 19:39:40.628299 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.628244 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c80a8750-07c5-4528-b873-81869857a54c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c80a8750-07c5-4528-b873-81869857a54c" (UID: "c80a8750-07c5-4528-b873-81869857a54c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:39:40.628831 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.628791 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c80a8750-07c5-4528-b873-81869857a54c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c80a8750-07c5-4528-b873-81869857a54c" (UID: "c80a8750-07c5-4528-b873-81869857a54c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:39:40.630597 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.630475 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c80a8750-07c5-4528-b873-81869857a54c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c80a8750-07c5-4528-b873-81869857a54c" (UID: "c80a8750-07c5-4528-b873-81869857a54c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:39:40.630894 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.630846 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c80a8750-07c5-4528-b873-81869857a54c" (UID: "c80a8750-07c5-4528-b873-81869857a54c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:39:40.631124 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.631091 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c80a8750-07c5-4528-b873-81869857a54c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c80a8750-07c5-4528-b873-81869857a54c" (UID: "c80a8750-07c5-4528-b873-81869857a54c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:39:40.632036 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.632016 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c80a8750-07c5-4528-b873-81869857a54c" (UID: "c80a8750-07c5-4528-b873-81869857a54c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:39:40.633242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.633216 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-kube-api-access-tcdg8" (OuterVolumeSpecName: "kube-api-access-tcdg8") pod "c80a8750-07c5-4528-b873-81869857a54c" (UID: "c80a8750-07c5-4528-b873-81869857a54c"). InnerVolumeSpecName "kube-api-access-tcdg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:39:40.639860 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.639828 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c80a8750-07c5-4528-b873-81869857a54c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c80a8750-07c5-4528-b873-81869857a54c" (UID: "c80a8750-07c5-4528-b873-81869857a54c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:39:40.713006 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.712932 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" event={"ID":"dd45707c-fe85-47f1-89d5-23bbba53f2d4","Type":"ContainerStarted","Data":"3e2612ebcb652d2f080d5295a364455ad366c688b2ac012a99a1b2e98a878f48"} Jul 08 19:39:40.714454 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.714417 2553 generic.go:356] "Generic (PLEG): container finished" podID="c80a8750-07c5-4528-b873-81869857a54c" containerID="7183f251dd3e1f8450290238d516263ab50221ce66f9664f8e72a5a91a62b5ec" exitCode=0 Jul 08 19:39:40.714575 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.714471 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" event={"ID":"c80a8750-07c5-4528-b873-81869857a54c","Type":"ContainerDied","Data":"7183f251dd3e1f8450290238d516263ab50221ce66f9664f8e72a5a91a62b5ec"} Jul 08 19:39:40.714575 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.714496 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" Jul 08 19:39:40.714575 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.714533 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56bfdf68c-v5vpx" event={"ID":"c80a8750-07c5-4528-b873-81869857a54c","Type":"ContainerDied","Data":"5d3a551d12ea6433b4b0322f802996955b2af7aaeeeeef6b6c9b844627798918"} Jul 08 19:39:40.714575 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.714564 2553 scope.go:117] "RemoveContainer" containerID="7183f251dd3e1f8450290238d516263ab50221ce66f9664f8e72a5a91a62b5ec" Jul 08 19:39:40.724246 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.724161 2553 scope.go:117] "RemoveContainer" containerID="7183f251dd3e1f8450290238d516263ab50221ce66f9664f8e72a5a91a62b5ec" Jul 08 19:39:40.724699 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:39:40.724671 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7183f251dd3e1f8450290238d516263ab50221ce66f9664f8e72a5a91a62b5ec\": container with ID starting with 7183f251dd3e1f8450290238d516263ab50221ce66f9664f8e72a5a91a62b5ec not found: ID does not exist" containerID="7183f251dd3e1f8450290238d516263ab50221ce66f9664f8e72a5a91a62b5ec" Jul 08 19:39:40.724792 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.724706 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7183f251dd3e1f8450290238d516263ab50221ce66f9664f8e72a5a91a62b5ec"} err="failed to get container status \"7183f251dd3e1f8450290238d516263ab50221ce66f9664f8e72a5a91a62b5ec\": rpc error: code = NotFound desc = could not find container \"7183f251dd3e1f8450290238d516263ab50221ce66f9664f8e72a5a91a62b5ec\": container with ID starting with 7183f251dd3e1f8450290238d516263ab50221ce66f9664f8e72a5a91a62b5ec not found: ID does not exist" Jul 08 19:39:40.728541 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.728518 2553 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c80a8750-07c5-4528-b873-81869857a54c-ca-trust-extracted\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:39:40.728631 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.728546 2553 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-bound-sa-token\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:39:40.728631 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.728564 2553 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c80a8750-07c5-4528-b873-81869857a54c-image-registry-private-configuration\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:39:40.728631 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.728579 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c80a8750-07c5-4528-b873-81869857a54c-trusted-ca\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:39:40.728631 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.728593 2553 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-registry-tls\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:39:40.728631 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.728606 2553 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c80a8750-07c5-4528-b873-81869857a54c-installation-pull-secrets\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:39:40.728631 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.728620 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcdg8\" (UniqueName: \"kubernetes.io/projected/c80a8750-07c5-4528-b873-81869857a54c-kube-api-access-tcdg8\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:39:40.728829 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.728634 2553 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c80a8750-07c5-4528-b873-81869857a54c-registry-certificates\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:39:40.740201 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.740171 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56bfdf68c-v5vpx"] Jul 08 19:39:40.745184 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.745162 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-56bfdf68c-v5vpx"] Jul 08 19:39:40.780954 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:40.780915 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c80a8750-07c5-4528-b873-81869857a54c" path="/var/lib/kubelet/pods/c80a8750-07c5-4528-b873-81869857a54c/volumes" Jul 08 19:39:41.579638 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.579602 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dd9b8cccd-wvwh6"] Jul 08 19:39:41.580020 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.579996 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c80a8750-07c5-4528-b873-81869857a54c" containerName="registry" Jul 08 19:39:41.580020 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.580016 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c80a8750-07c5-4528-b873-81869857a54c" containerName="registry" Jul 08 19:39:41.580200 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.580076 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c80a8750-07c5-4528-b873-81869857a54c" containerName="registry" Jul 08 19:39:41.583359 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.583332 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.586165 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.586139 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 19:39:41.586278 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.586211 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 19:39:41.587752 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.587497 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 19:39:41.587752 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.587517 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 19:39:41.587752 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.587520 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 19:39:41.587752 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.587577 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g8qt2\"" Jul 08 19:39:41.597601 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.597576 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dd9b8cccd-wvwh6"] Jul 08 19:39:41.635965 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.635940 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/762b73ae-b4fa-4736-abf2-c6fa99af0d02-console-oauth-config\") pod \"console-6dd9b8cccd-wvwh6\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.636101 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.636002 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/762b73ae-b4fa-4736-abf2-c6fa99af0d02-service-ca\") pod \"console-6dd9b8cccd-wvwh6\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.636101 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.636065 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl9t8\" (UniqueName: \"kubernetes.io/projected/762b73ae-b4fa-4736-abf2-c6fa99af0d02-kube-api-access-jl9t8\") pod \"console-6dd9b8cccd-wvwh6\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.636228 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.636106 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/762b73ae-b4fa-4736-abf2-c6fa99af0d02-console-config\") pod \"console-6dd9b8cccd-wvwh6\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.636228 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.636146 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/762b73ae-b4fa-4736-abf2-c6fa99af0d02-console-serving-cert\") pod \"console-6dd9b8cccd-wvwh6\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.636319 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.636227 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/762b73ae-b4fa-4736-abf2-c6fa99af0d02-oauth-serving-cert\") pod \"console-6dd9b8cccd-wvwh6\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.736859 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.736834 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/762b73ae-b4fa-4736-abf2-c6fa99af0d02-console-config\") pod \"console-6dd9b8cccd-wvwh6\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.737196 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.736884 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/762b73ae-b4fa-4736-abf2-c6fa99af0d02-console-serving-cert\") pod \"console-6dd9b8cccd-wvwh6\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.737196 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.737084 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/762b73ae-b4fa-4736-abf2-c6fa99af0d02-oauth-serving-cert\") pod \"console-6dd9b8cccd-wvwh6\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.737196 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.737171 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/762b73ae-b4fa-4736-abf2-c6fa99af0d02-console-oauth-config\") pod \"console-6dd9b8cccd-wvwh6\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.737363 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.737218 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/762b73ae-b4fa-4736-abf2-c6fa99af0d02-service-ca\") pod \"console-6dd9b8cccd-wvwh6\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.737363 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.737250 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl9t8\" (UniqueName: \"kubernetes.io/projected/762b73ae-b4fa-4736-abf2-c6fa99af0d02-kube-api-access-jl9t8\") pod \"console-6dd9b8cccd-wvwh6\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.737643 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.737620 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/762b73ae-b4fa-4736-abf2-c6fa99af0d02-console-config\") pod \"console-6dd9b8cccd-wvwh6\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.737874 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.737848 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/762b73ae-b4fa-4736-abf2-c6fa99af0d02-oauth-serving-cert\") pod \"console-6dd9b8cccd-wvwh6\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.738007 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.737986 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/762b73ae-b4fa-4736-abf2-c6fa99af0d02-service-ca\") pod \"console-6dd9b8cccd-wvwh6\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.739942 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.739865 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/762b73ae-b4fa-4736-abf2-c6fa99af0d02-console-serving-cert\") pod \"console-6dd9b8cccd-wvwh6\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.740078 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.739991 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/762b73ae-b4fa-4736-abf2-c6fa99af0d02-console-oauth-config\") pod \"console-6dd9b8cccd-wvwh6\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.745662 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.745642 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl9t8\" (UniqueName: \"kubernetes.io/projected/762b73ae-b4fa-4736-abf2-c6fa99af0d02-kube-api-access-jl9t8\") pod \"console-6dd9b8cccd-wvwh6\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:41.895472 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:41.895425 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:39:42.059254 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:42.059230 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dd9b8cccd-wvwh6"] Jul 08 19:39:42.061667 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:39:42.061635 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod762b73ae_b4fa_4736_abf2_c6fa99af0d02.slice/crio-0a0014f8213eb8bc2c5f89fc4937f397045936428ae5f0d9c28f9e5891a91bac WatchSource:0}: Error finding container 0a0014f8213eb8bc2c5f89fc4937f397045936428ae5f0d9c28f9e5891a91bac: Status 404 returned error can't find the container with id 0a0014f8213eb8bc2c5f89fc4937f397045936428ae5f0d9c28f9e5891a91bac Jul 08 19:39:42.727189 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:42.727127 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" event={"ID":"dd45707c-fe85-47f1-89d5-23bbba53f2d4","Type":"ContainerStarted","Data":"2236714e00ec21a04f6884cf0cf82560e1cdd727e9aad145249dd4c425b8426a"} Jul 08 19:39:42.727374 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:42.727196 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" event={"ID":"dd45707c-fe85-47f1-89d5-23bbba53f2d4","Type":"ContainerStarted","Data":"6e3413c66940b052d7c048686ae62fec4dda7be7b45a744c7e069013b3ed9ba7"} Jul 08 19:39:42.728877 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:42.728847 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd9b8cccd-wvwh6" event={"ID":"762b73ae-b4fa-4736-abf2-c6fa99af0d02","Type":"ContainerStarted","Data":"0a0014f8213eb8bc2c5f89fc4937f397045936428ae5f0d9c28f9e5891a91bac"} Jul 08 19:39:42.751917 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:42.751863 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-775f7b5cf6-mkjgk" podStartSLOduration=2.013539149 podStartE2EDuration="5.751842486s" totalImagesPullingTime="3.738303337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:39:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:42.748986937 +0000 UTC m=+304.502631206" watchObservedRunningTime="2026-07-08 19:39:42.751842486 +0000 UTC m=+304.505486728" Jul 08 19:39:44.242734 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.242701 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b9ff676b-2852v"] Jul 08 19:39:44.248384 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.248354 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.260450 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.260408 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 19:39:44.261317 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.261282 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b9ff676b-2852v"] Jul 08 19:39:44.363234 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.363051 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-trusted-ca-bundle\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.363234 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.363125 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-console-config\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.363234 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.363164 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-service-ca\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.363234 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.363199 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d542cb54-999b-4fa8-8153-635d3455b6ce-console-oauth-config\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.363777 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.363278 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts2qx\" (UniqueName: \"kubernetes.io/projected/d542cb54-999b-4fa8-8153-635d3455b6ce-kube-api-access-ts2qx\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.363777 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.363336 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-oauth-serving-cert\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.363777 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.363400 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d542cb54-999b-4fa8-8153-635d3455b6ce-console-serving-cert\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.464756 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.463905 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-service-ca\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.464756 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.463974 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d542cb54-999b-4fa8-8153-635d3455b6ce-console-oauth-config\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.464756 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.464013 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts2qx\" (UniqueName: \"kubernetes.io/projected/d542cb54-999b-4fa8-8153-635d3455b6ce-kube-api-access-ts2qx\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.464756 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.464073 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-oauth-serving-cert\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.464756 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.464128 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d542cb54-999b-4fa8-8153-635d3455b6ce-console-serving-cert\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.464756 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.464186 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-trusted-ca-bundle\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.464756 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.464238 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-console-config\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.465216 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.465161 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-console-config\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.465721 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.465696 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-service-ca\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.465977 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.465942 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-trusted-ca-bundle\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.466128 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.466104 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-oauth-serving-cert\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.467698 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.467677 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d542cb54-999b-4fa8-8153-635d3455b6ce-console-oauth-config\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.468117 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.468091 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d542cb54-999b-4fa8-8153-635d3455b6ce-console-serving-cert\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.473864 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.473832 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts2qx\" (UniqueName: \"kubernetes.io/projected/d542cb54-999b-4fa8-8153-635d3455b6ce-kube-api-access-ts2qx\") pod \"console-b9ff676b-2852v\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:44.563224 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:44.563173 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:47.772345 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:47.772312 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:39:52.520893 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:52.520867 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b9ff676b-2852v"] Jul 08 19:39:52.522995 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:39:52.522962 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd542cb54_999b_4fa8_8153_635d3455b6ce.slice/crio-1b5ab7539bde75c0097a99d38533a5c0eff3d528e83cb07cabd374ab515ff1d6 WatchSource:0}: Error finding container 1b5ab7539bde75c0097a99d38533a5c0eff3d528e83cb07cabd374ab515ff1d6: Status 404 returned error can't find the container with id 1b5ab7539bde75c0097a99d38533a5c0eff3d528e83cb07cabd374ab515ff1d6 Jul 08 19:39:52.778973 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:52.778938 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd9b8cccd-wvwh6" event={"ID":"762b73ae-b4fa-4736-abf2-c6fa99af0d02","Type":"ContainerStarted","Data":"5c30b947e60f0e099e03db605d942b34c33a581c2f5b926c1cc95043f9db152d"} Jul 08 19:39:52.779224 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:52.779202 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-gbdvb" Jul 08 19:39:52.779327 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:52.779239 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-gbdvb" event={"ID":"62792e1e-c855-4450-9429-84cc68c896c9","Type":"ContainerStarted","Data":"52e48059ce7ae370b43c2d9505ebd25ad77a7d4b53c87976d69ddbe18510415d"} Jul 08 19:39:52.780348 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:52.779956 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9ff676b-2852v" event={"ID":"d542cb54-999b-4fa8-8153-635d3455b6ce","Type":"ContainerStarted","Data":"7841f546697092ce7365e0f9d30924d3d6e026d8667f5f32087effeae721031e"} Jul 08 19:39:52.780348 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:52.780001 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9ff676b-2852v" event={"ID":"d542cb54-999b-4fa8-8153-635d3455b6ce","Type":"ContainerStarted","Data":"1b5ab7539bde75c0097a99d38533a5c0eff3d528e83cb07cabd374ab515ff1d6"} Jul 08 19:39:52.795942 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:52.795886 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dd9b8cccd-wvwh6" podStartSLOduration=1.461201022 podStartE2EDuration="11.795869926s" totalImagesPullingTime="10.334668904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:52.795527386 +0000 UTC m=+314.549171674" watchObservedRunningTime="2026-07-08 19:39:52.795869926 +0000 UTC m=+314.549514168" Jul 08 19:39:52.798380 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:52.798348 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-gbdvb" Jul 08 19:39:52.815635 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:52.815595 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-gbdvb" podStartSLOduration=1.452242132 podStartE2EDuration="20.815580887s" totalImagesPullingTime="19.363338755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:52.814566815 +0000 UTC m=+314.568211057" watchObservedRunningTime="2026-07-08 19:39:52.815580887 +0000 UTC m=+314.569225151" Jul 08 19:39:52.837241 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:52.837189 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b9ff676b-2852v" podStartSLOduration=8.837170448 podStartE2EDuration="8.837170448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:39:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:39:52.836547451 +0000 UTC m=+314.590191721" watchObservedRunningTime="2026-07-08 19:39:52.837170448 +0000 UTC m=+314.590814690" Jul 08 19:39:54.564160 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:54.564123 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:54.564627 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:54.564192 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:54.570037 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:54.570010 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:54.793720 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:54.793691 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:39:54.845592 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:54.845515 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dd9b8cccd-wvwh6"] Jul 08 19:39:56.800816 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:56.800775 2553 generic.go:356] "Generic (PLEG): container finished" podID="a8078098-b1d0-4222-b1eb-9c116df84482" containerID="f6642d6a6bf515529ce7baff46a63eb33ac922c3599c3f8d54ed0dbae17917e3" exitCode=0 Jul 08 19:39:56.801240 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:56.800856 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" event={"ID":"a8078098-b1d0-4222-b1eb-9c116df84482","Type":"ContainerDied","Data":"f6642d6a6bf515529ce7baff46a63eb33ac922c3599c3f8d54ed0dbae17917e3"} Jul 08 19:39:56.801381 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:56.801356 2553 scope.go:117] "RemoveContainer" containerID="f6642d6a6bf515529ce7baff46a63eb33ac922c3599c3f8d54ed0dbae17917e3" Jul 08 19:39:56.870888 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:56.870860 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:56.871022 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:56.870923 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:39:57.808152 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:57.808111 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-gcp4k" event={"ID":"a8078098-b1d0-4222-b1eb-9c116df84482","Type":"ContainerStarted","Data":"04b23f5568f04c3d85c52c3d6c8ec0782b6235921bb842ab0af5933e51925098"} Jul 08 19:39:59.380991 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:59.380961 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-xbkp8_a5a21740-6f8c-469f-a810-0ec194db1d62/kube-state-metrics/0.log" Jul 08 19:39:59.579933 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:59.579902 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-xbkp8_a5a21740-6f8c-469f-a810-0ec194db1d62/kube-rbac-proxy-main/0.log" Jul 08 19:39:59.780367 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:59.780336 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-xbkp8_a5a21740-6f8c-469f-a810-0ec194db1d62/kube-rbac-proxy-self/0.log" Jul 08 19:39:59.981176 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:39:59.981146 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-55cc7b7d9f-7svmw_764a6522-bd60-4373-a26e-fe67898f342f/metrics-server/0.log" Jul 08 19:40:00.980219 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:00.980190 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ll4dk_5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3/init-textfile/0.log" Jul 08 19:40:01.182086 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:01.182058 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ll4dk_5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3/node-exporter/0.log" Jul 08 19:40:01.382459 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:01.382407 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ll4dk_5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3/kube-rbac-proxy/0.log" Jul 08 19:40:01.896342 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:01.896301 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:40:04.183344 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:04.183309 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-dtwgb_d9e1337a-4870-492b-a157-98c8aee258e9/prometheus-operator/0.log" Jul 08 19:40:04.383720 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:04.383686 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-dtwgb_d9e1337a-4870-492b-a157-98c8aee258e9/kube-rbac-proxy/0.log" Jul 08 19:40:04.580392 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:04.580362 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-6qwwn_28b182f8-fa3c-4a5a-8018-ccd6cdf3d058/prometheus-operator-admission-webhook/0.log" Jul 08 19:40:04.781823 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:04.781795 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-775f7b5cf6-mkjgk_dd45707c-fe85-47f1-89d5-23bbba53f2d4/telemeter-client/0.log" Jul 08 19:40:04.979862 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:04.979791 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-775f7b5cf6-mkjgk_dd45707c-fe85-47f1-89d5-23bbba53f2d4/reload/0.log" Jul 08 19:40:05.180193 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:05.180136 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-775f7b5cf6-mkjgk_dd45707c-fe85-47f1-89d5-23bbba53f2d4/kube-rbac-proxy/0.log" Jul 08 19:40:06.779233 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:06.779211 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gh46n_9d41e4e9-4418-4797-acea-bca615f11b0f/console-operator/2.log" Jul 08 19:40:06.983798 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:06.983765 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gh46n_9d41e4e9-4418-4797-acea-bca615f11b0f/console-operator/3.log" Jul 08 19:40:07.181153 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:07.181080 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6dd9b8cccd-wvwh6_762b73ae-b4fa-4736-abf2-c6fa99af0d02/console/0.log" Jul 08 19:40:07.380384 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:07.380357 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b9ff676b-2852v_d542cb54-999b-4fa8-8153-635d3455b6ce/console/0.log" Jul 08 19:40:07.581623 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:07.581596 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-gbdvb_62792e1e-c855-4450-9429-84cc68c896c9/download-server/0.log" Jul 08 19:40:07.784991 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:07.784958 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-56fcf86bf-v9rpc_ac461a89-bf5e-4a12-872b-ca3a47602be5/cluster-samples-operator/0.log" Jul 08 19:40:07.980588 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:07.980494 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-56fcf86bf-v9rpc_ac461a89-bf5e-4a12-872b-ca3a47602be5/cluster-samples-operator-watch/0.log" Jul 08 19:40:16.876192 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:16.876162 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:40:16.880021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:16.879993 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-55cc7b7d9f-7svmw" Jul 08 19:40:19.872363 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:19.872319 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6dd9b8cccd-wvwh6" podUID="762b73ae-b4fa-4736-abf2-c6fa99af0d02" containerName="console" containerID="cri-o://5c30b947e60f0e099e03db605d942b34c33a581c2f5b926c1cc95043f9db152d" gracePeriod=15 Jul 08 19:40:20.138822 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.138756 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:40:20.186423 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.186395 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/762b73ae-b4fa-4736-abf2-c6fa99af0d02-console-serving-cert\") pod \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " Jul 08 19:40:20.186566 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.186480 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl9t8\" (UniqueName: \"kubernetes.io/projected/762b73ae-b4fa-4736-abf2-c6fa99af0d02-kube-api-access-jl9t8\") pod \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " Jul 08 19:40:20.186566 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.186504 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/762b73ae-b4fa-4736-abf2-c6fa99af0d02-console-oauth-config\") pod \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " Jul 08 19:40:20.186566 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.186524 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/762b73ae-b4fa-4736-abf2-c6fa99af0d02-console-config\") pod \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " Jul 08 19:40:20.186566 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.186557 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/762b73ae-b4fa-4736-abf2-c6fa99af0d02-service-ca\") pod \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " Jul 08 19:40:20.186757 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.186576 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/762b73ae-b4fa-4736-abf2-c6fa99af0d02-oauth-serving-cert\") pod \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\" (UID: \"762b73ae-b4fa-4736-abf2-c6fa99af0d02\") " Jul 08 19:40:20.186946 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.186918 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/762b73ae-b4fa-4736-abf2-c6fa99af0d02-console-config" (OuterVolumeSpecName: "console-config") pod "762b73ae-b4fa-4736-abf2-c6fa99af0d02" (UID: "762b73ae-b4fa-4736-abf2-c6fa99af0d02"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:40:20.187060 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.186976 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/762b73ae-b4fa-4736-abf2-c6fa99af0d02-service-ca" (OuterVolumeSpecName: "service-ca") pod "762b73ae-b4fa-4736-abf2-c6fa99af0d02" (UID: "762b73ae-b4fa-4736-abf2-c6fa99af0d02"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:40:20.187060 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.187039 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/762b73ae-b4fa-4736-abf2-c6fa99af0d02-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "762b73ae-b4fa-4736-abf2-c6fa99af0d02" (UID: "762b73ae-b4fa-4736-abf2-c6fa99af0d02"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:40:20.188750 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.188724 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/762b73ae-b4fa-4736-abf2-c6fa99af0d02-kube-api-access-jl9t8" (OuterVolumeSpecName: "kube-api-access-jl9t8") pod "762b73ae-b4fa-4736-abf2-c6fa99af0d02" (UID: "762b73ae-b4fa-4736-abf2-c6fa99af0d02"). InnerVolumeSpecName "kube-api-access-jl9t8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:40:20.188835 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.188786 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/762b73ae-b4fa-4736-abf2-c6fa99af0d02-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "762b73ae-b4fa-4736-abf2-c6fa99af0d02" (UID: "762b73ae-b4fa-4736-abf2-c6fa99af0d02"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:20.188835 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.188813 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/762b73ae-b4fa-4736-abf2-c6fa99af0d02-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "762b73ae-b4fa-4736-abf2-c6fa99af0d02" (UID: "762b73ae-b4fa-4736-abf2-c6fa99af0d02"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:40:20.287368 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.287336 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl9t8\" (UniqueName: \"kubernetes.io/projected/762b73ae-b4fa-4736-abf2-c6fa99af0d02-kube-api-access-jl9t8\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:40:20.287368 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.287362 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/762b73ae-b4fa-4736-abf2-c6fa99af0d02-console-oauth-config\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:40:20.287368 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.287374 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/762b73ae-b4fa-4736-abf2-c6fa99af0d02-console-config\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:40:20.287581 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.287384 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/762b73ae-b4fa-4736-abf2-c6fa99af0d02-service-ca\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:40:20.287581 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.287392 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/762b73ae-b4fa-4736-abf2-c6fa99af0d02-oauth-serving-cert\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:40:20.287581 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.287400 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/762b73ae-b4fa-4736-abf2-c6fa99af0d02-console-serving-cert\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:40:20.912024 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.911991 2553 generic.go:356] "Generic (PLEG): container finished" podID="762b73ae-b4fa-4736-abf2-c6fa99af0d02" containerID="5c30b947e60f0e099e03db605d942b34c33a581c2f5b926c1cc95043f9db152d" exitCode=0 Jul 08 19:40:20.912497 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.912039 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dd9b8cccd-wvwh6" Jul 08 19:40:20.912497 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.912055 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd9b8cccd-wvwh6" event={"ID":"762b73ae-b4fa-4736-abf2-c6fa99af0d02","Type":"ContainerDied","Data":"5c30b947e60f0e099e03db605d942b34c33a581c2f5b926c1cc95043f9db152d"} Jul 08 19:40:20.912497 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.912096 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dd9b8cccd-wvwh6" event={"ID":"762b73ae-b4fa-4736-abf2-c6fa99af0d02","Type":"ContainerDied","Data":"0a0014f8213eb8bc2c5f89fc4937f397045936428ae5f0d9c28f9e5891a91bac"} Jul 08 19:40:20.912497 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.912119 2553 scope.go:117] "RemoveContainer" containerID="5c30b947e60f0e099e03db605d942b34c33a581c2f5b926c1cc95043f9db152d" Jul 08 19:40:20.920169 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.920151 2553 scope.go:117] "RemoveContainer" containerID="5c30b947e60f0e099e03db605d942b34c33a581c2f5b926c1cc95043f9db152d" Jul 08 19:40:20.920398 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:40:20.920382 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c30b947e60f0e099e03db605d942b34c33a581c2f5b926c1cc95043f9db152d\": container with ID starting with 5c30b947e60f0e099e03db605d942b34c33a581c2f5b926c1cc95043f9db152d not found: ID does not exist" containerID="5c30b947e60f0e099e03db605d942b34c33a581c2f5b926c1cc95043f9db152d" Jul 08 19:40:20.920472 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.920405 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c30b947e60f0e099e03db605d942b34c33a581c2f5b926c1cc95043f9db152d"} err="failed to get container status \"5c30b947e60f0e099e03db605d942b34c33a581c2f5b926c1cc95043f9db152d\": rpc error: code = NotFound desc = could not find container \"5c30b947e60f0e099e03db605d942b34c33a581c2f5b926c1cc95043f9db152d\": container with ID starting with 5c30b947e60f0e099e03db605d942b34c33a581c2f5b926c1cc95043f9db152d not found: ID does not exist" Jul 08 19:40:20.927237 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.927215 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dd9b8cccd-wvwh6"] Jul 08 19:40:20.928856 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:20.928836 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dd9b8cccd-wvwh6"] Jul 08 19:40:22.776925 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:22.776894 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="762b73ae-b4fa-4736-abf2-c6fa99af0d02" path="/var/lib/kubelet/pods/762b73ae-b4fa-4736-abf2-c6fa99af0d02/volumes" Jul 08 19:40:22.921636 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:22.921603 2553 generic.go:356] "Generic (PLEG): container finished" podID="cde4c83a-9651-4090-8008-65ea0e65cdf0" containerID="4d88ba35bfd6d3637f65f3c51b83392d53ab10751f80fab42b3ac424cedd847b" exitCode=0 Jul 08 19:40:22.921818 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:22.921676 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n" event={"ID":"cde4c83a-9651-4090-8008-65ea0e65cdf0","Type":"ContainerDied","Data":"4d88ba35bfd6d3637f65f3c51b83392d53ab10751f80fab42b3ac424cedd847b"} Jul 08 19:40:22.922011 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:22.921994 2553 scope.go:117] "RemoveContainer" containerID="4d88ba35bfd6d3637f65f3c51b83392d53ab10751f80fab42b3ac424cedd847b" Jul 08 19:40:23.927469 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:23.927416 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cl26n" event={"ID":"cde4c83a-9651-4090-8008-65ea0e65cdf0","Type":"ContainerStarted","Data":"81cc82103264e228a285033a5f7f2d49bbcc170298ffb9c125a0b3b6ac6ea30e"} Jul 08 19:40:51.429774 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.429739 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bb59844f7-hrnss"] Jul 08 19:40:51.431865 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.431838 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="762b73ae-b4fa-4736-abf2-c6fa99af0d02" containerName="console" Jul 08 19:40:51.432028 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.432016 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="762b73ae-b4fa-4736-abf2-c6fa99af0d02" containerName="console" Jul 08 19:40:51.432201 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.432189 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="762b73ae-b4fa-4736-abf2-c6fa99af0d02" containerName="console" Jul 08 19:40:51.435190 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.435160 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.442536 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.442501 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb59844f7-hrnss"] Jul 08 19:40:51.536140 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.536108 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-console-config\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.536140 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.536143 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kttkz\" (UniqueName: \"kubernetes.io/projected/135a6301-f6af-45dd-b800-cdd49ef2c546-kube-api-access-kttkz\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.536325 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.536175 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/135a6301-f6af-45dd-b800-cdd49ef2c546-console-oauth-config\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.536325 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.536301 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-service-ca\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.536406 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.536331 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-trusted-ca-bundle\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.536406 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.536356 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-oauth-serving-cert\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.536406 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.536397 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/135a6301-f6af-45dd-b800-cdd49ef2c546-console-serving-cert\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.637456 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.637407 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-service-ca\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.637456 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.637458 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-trusted-ca-bundle\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.637721 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.637479 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-oauth-serving-cert\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.637721 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.637507 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/135a6301-f6af-45dd-b800-cdd49ef2c546-console-serving-cert\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.637721 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.637541 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-console-config\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.637721 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.637570 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kttkz\" (UniqueName: \"kubernetes.io/projected/135a6301-f6af-45dd-b800-cdd49ef2c546-kube-api-access-kttkz\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.637921 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.637722 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/135a6301-f6af-45dd-b800-cdd49ef2c546-console-oauth-config\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.638200 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.638175 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-service-ca\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.638305 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.638240 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-oauth-serving-cert\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.638419 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.638399 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-console-config\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.638501 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.638422 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-trusted-ca-bundle\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.640035 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.640006 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/135a6301-f6af-45dd-b800-cdd49ef2c546-console-serving-cert\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.640035 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.640028 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/135a6301-f6af-45dd-b800-cdd49ef2c546-console-oauth-config\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.646840 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.646822 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kttkz\" (UniqueName: \"kubernetes.io/projected/135a6301-f6af-45dd-b800-cdd49ef2c546-kube-api-access-kttkz\") pod \"console-7bb59844f7-hrnss\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.745788 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.745730 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:40:51.877481 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:51.877455 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb59844f7-hrnss"] Jul 08 19:40:51.880064 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:40:51.880036 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod135a6301_f6af_45dd_b800_cdd49ef2c546.slice/crio-cf04e6761733f17a77a94d720a0b9a08e3b8ccbe08cecd65406cb82ddca0aa6d WatchSource:0}: Error finding container cf04e6761733f17a77a94d720a0b9a08e3b8ccbe08cecd65406cb82ddca0aa6d: Status 404 returned error can't find the container with id cf04e6761733f17a77a94d720a0b9a08e3b8ccbe08cecd65406cb82ddca0aa6d Jul 08 19:40:52.034411 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:52.034373 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb59844f7-hrnss" event={"ID":"135a6301-f6af-45dd-b800-cdd49ef2c546","Type":"ContainerStarted","Data":"36e4754538437b6fc5774e19d1fe2154788ff91e74f1129d71622aafc44c7e6a"} Jul 08 19:40:52.034568 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:52.034447 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb59844f7-hrnss" event={"ID":"135a6301-f6af-45dd-b800-cdd49ef2c546","Type":"ContainerStarted","Data":"cf04e6761733f17a77a94d720a0b9a08e3b8ccbe08cecd65406cb82ddca0aa6d"} Jul 08 19:40:52.057300 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:52.057259 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bb59844f7-hrnss" podStartSLOduration=1.057243359 podStartE2EDuration="1.057243359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:40:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:40:52.056989854 +0000 UTC m=+373.810634097" watchObservedRunningTime="2026-07-08 19:40:52.057243359 +0000 UTC m=+373.810887603" Jul 08 19:40:52.447121 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:52.447042 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs\") pod \"network-metrics-daemon-4n4kl\" (UID: \"df97169f-20ad-4b99-b6c8-9cec807f0296\") " pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:40:52.449358 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:52.449325 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df97169f-20ad-4b99-b6c8-9cec807f0296-metrics-certs\") pod \"network-metrics-daemon-4n4kl\" (UID: \"df97169f-20ad-4b99-b6c8-9cec807f0296\") " pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:40:52.576182 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:52.575981 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b6785\"" Jul 08 19:40:52.584388 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:52.584365 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4n4kl" Jul 08 19:40:52.707719 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:52.707696 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4n4kl"] Jul 08 19:40:52.709960 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:40:52.709934 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf97169f_20ad_4b99_b6c8_9cec807f0296.slice/crio-3027bbd56f34d3afb9fd96901da9c1732f0bbf9a5cee15d08bf9de9c4d678446 WatchSource:0}: Error finding container 3027bbd56f34d3afb9fd96901da9c1732f0bbf9a5cee15d08bf9de9c4d678446: Status 404 returned error can't find the container with id 3027bbd56f34d3afb9fd96901da9c1732f0bbf9a5cee15d08bf9de9c4d678446 Jul 08 19:40:53.039017 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:53.038981 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4n4kl" event={"ID":"df97169f-20ad-4b99-b6c8-9cec807f0296","Type":"ContainerStarted","Data":"3027bbd56f34d3afb9fd96901da9c1732f0bbf9a5cee15d08bf9de9c4d678446"} Jul 08 19:40:54.045136 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.045102 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4n4kl" event={"ID":"df97169f-20ad-4b99-b6c8-9cec807f0296","Type":"ContainerStarted","Data":"7e720148199f2c092bca59bb79c13da348b91f6c3b044411e74336d8de193b3c"} Jul 08 19:40:54.045619 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.045160 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4n4kl" event={"ID":"df97169f-20ad-4b99-b6c8-9cec807f0296","Type":"ContainerStarted","Data":"6575c9a762940b9048f0407a0a176313d67082a81672306ef9d30e330a5f2558"} Jul 08 19:40:54.061713 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.061656 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4n4kl" podStartSLOduration=374.046262429 podStartE2EDuration="6m15.061637427s" totalImagesPullingTime="1.015374998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:40:54.059250499 +0000 UTC m=+375.812894797" watchObservedRunningTime="2026-07-08 19:40:54.061637427 +0000 UTC m=+375.815281669" Jul 08 19:40:54.802337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.802302 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:40:54.806729 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.806704 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:54.809371 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.809308 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 19:40:54.809371 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.809308 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 19:40:54.809371 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.809348 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 19:40:54.809371 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.809378 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 19:40:54.809927 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.809535 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 19:40:54.809927 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.809810 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-g8lw2\"" Jul 08 19:40:54.809927 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.809825 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 19:40:54.809927 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.809813 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 19:40:54.810084 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.810017 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 19:40:54.814999 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.814980 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 19:40:54.821000 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.820979 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:40:54.969141 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.969102 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/782bc28e-99b3-40ba-a4f6-5249c262fe0d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:54.969301 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.969195 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:54.969301 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.969234 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-config-volume\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:54.969301 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.969253 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:54.969301 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.969277 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/782bc28e-99b3-40ba-a4f6-5249c262fe0d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:54.969479 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.969328 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/782bc28e-99b3-40ba-a4f6-5249c262fe0d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:54.969479 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.969386 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:54.969479 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.969412 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/782bc28e-99b3-40ba-a4f6-5249c262fe0d-config-out\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:54.969479 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.969428 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msvm6\" (UniqueName: \"kubernetes.io/projected/782bc28e-99b3-40ba-a4f6-5249c262fe0d-kube-api-access-msvm6\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:54.969479 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.969477 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/782bc28e-99b3-40ba-a4f6-5249c262fe0d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:54.969665 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.969503 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:54.969665 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.969535 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:54.969665 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:54.969557 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-web-config\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.070953 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.070881 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/782bc28e-99b3-40ba-a4f6-5249c262fe0d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.070953 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.070922 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.070953 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.070941 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-config-volume\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.071545 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.070986 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.071545 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.071016 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/782bc28e-99b3-40ba-a4f6-5249c262fe0d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.071545 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.071041 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/782bc28e-99b3-40ba-a4f6-5249c262fe0d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.071545 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.071072 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.071545 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.071099 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/782bc28e-99b3-40ba-a4f6-5249c262fe0d-config-out\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.071545 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.071122 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msvm6\" (UniqueName: \"kubernetes.io/projected/782bc28e-99b3-40ba-a4f6-5249c262fe0d-kube-api-access-msvm6\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.071545 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.071155 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/782bc28e-99b3-40ba-a4f6-5249c262fe0d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.071545 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.071197 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.071545 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.071234 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.071545 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.071264 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-web-config\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.071545 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.071497 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/782bc28e-99b3-40ba-a4f6-5249c262fe0d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.072259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.072239 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/782bc28e-99b3-40ba-a4f6-5249c262fe0d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.073030 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.073005 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/782bc28e-99b3-40ba-a4f6-5249c262fe0d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.074008 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.073974 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/782bc28e-99b3-40ba-a4f6-5249c262fe0d-config-out\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.074008 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.073993 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.074148 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.074059 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-config-volume\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.074148 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.074141 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-web-config\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.074280 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.074247 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.074324 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.074281 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.074797 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.074775 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/782bc28e-99b3-40ba-a4f6-5249c262fe0d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.075911 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.075890 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.076198 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.076181 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/782bc28e-99b3-40ba-a4f6-5249c262fe0d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.083055 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.083036 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msvm6\" (UniqueName: \"kubernetes.io/projected/782bc28e-99b3-40ba-a4f6-5249c262fe0d-kube-api-access-msvm6\") pod \"alertmanager-main-0\" (UID: \"782bc28e-99b3-40ba-a4f6-5249c262fe0d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.116075 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.116056 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:40:55.258328 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:55.258305 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:40:55.260351 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:40:55.260314 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod782bc28e_99b3_40ba_a4f6_5249c262fe0d.slice/crio-b92cecf96ec27e42730d3cad590b336bd1afcc6d2d6543a6e5d5f1acf0f6b8d0 WatchSource:0}: Error finding container b92cecf96ec27e42730d3cad590b336bd1afcc6d2d6543a6e5d5f1acf0f6b8d0: Status 404 returned error can't find the container with id b92cecf96ec27e42730d3cad590b336bd1afcc6d2d6543a6e5d5f1acf0f6b8d0 Jul 08 19:40:56.053790 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:56.053759 2553 generic.go:356] "Generic (PLEG): container finished" podID="782bc28e-99b3-40ba-a4f6-5249c262fe0d" containerID="1d586ab59f2039bc77875b592d37974dcf824aeeaf6025746c6c21e6a1edf7a7" exitCode=0 Jul 08 19:40:56.053957 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:56.053827 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"782bc28e-99b3-40ba-a4f6-5249c262fe0d","Type":"ContainerDied","Data":"1d586ab59f2039bc77875b592d37974dcf824aeeaf6025746c6c21e6a1edf7a7"} Jul 08 19:40:56.053957 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:56.053875 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"782bc28e-99b3-40ba-a4f6-5249c262fe0d","Type":"ContainerStarted","Data":"b92cecf96ec27e42730d3cad590b336bd1afcc6d2d6543a6e5d5f1acf0f6b8d0"} Jul 08 19:40:58.068105 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:58.068077 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"782bc28e-99b3-40ba-a4f6-5249c262fe0d","Type":"ContainerStarted","Data":"8c3544497f67211cc8237116c9a54ca85bed7837ca9461a0a8e6628dac8cc1f3"} Jul 08 19:40:58.068381 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:58.068156 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"782bc28e-99b3-40ba-a4f6-5249c262fe0d","Type":"ContainerStarted","Data":"b79c93a72f27a2dbecdb697d7ad20243e034186ba982e7cbe8a10589099d8580"} Jul 08 19:40:59.075339 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:59.075309 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"782bc28e-99b3-40ba-a4f6-5249c262fe0d","Type":"ContainerStarted","Data":"bfeef50ff48d29e6a8e4b21eee139cdaa9a4a4f15a5fb999a0ddabf15ccf4b28"} Jul 08 19:40:59.075631 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:59.075379 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"782bc28e-99b3-40ba-a4f6-5249c262fe0d","Type":"ContainerStarted","Data":"b5a3d0bddf6f3d92247128fb8d6ea4cafe42ea1e71828277b9d0c480335ac924"} Jul 08 19:40:59.075631 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:40:59.075405 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"782bc28e-99b3-40ba-a4f6-5249c262fe0d","Type":"ContainerStarted","Data":"fb5ae215b8f12c835e235a9efba4d04e4d5b30e7c77292f03ddcd059e214dbe0"} Jul 08 19:41:00.082855 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:00.082825 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"782bc28e-99b3-40ba-a4f6-5249c262fe0d","Type":"ContainerStarted","Data":"cdbdc29396188b770f57889a0e31a253f088bd5fae450307be83af17640c9e89"} Jul 08 19:41:00.115009 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:00.114960 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.356121187 podStartE2EDuration="6.114941589s" totalImagesPullingTime="2.742155206s" totalInitContainerRuntime="16.665196ms" isStatefulPod=false podCreationTimestamp="2026-07-08 19:40:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:41:00.114251731 +0000 UTC m=+381.867895973" watchObservedRunningTime="2026-07-08 19:41:00.114941589 +0000 UTC m=+381.868585830" Jul 08 19:41:01.745961 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:01.745931 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:41:01.746337 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:01.746239 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:41:01.750800 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:01.750782 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:41:02.094375 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:02.094348 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:41:02.140834 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:02.140806 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b9ff676b-2852v"] Jul 08 19:41:27.161390 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.161347 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b9ff676b-2852v" podUID="d542cb54-999b-4fa8-8153-635d3455b6ce" containerName="console" containerID="cri-o://7841f546697092ce7365e0f9d30924d3d6e026d8667f5f32087effeae721031e" gracePeriod=15 Jul 08 19:41:27.406674 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.406647 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:41:27.541528 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.541503 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-trusted-ca-bundle\") pod \"d542cb54-999b-4fa8-8153-635d3455b6ce\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " Jul 08 19:41:27.541679 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.541536 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts2qx\" (UniqueName: \"kubernetes.io/projected/d542cb54-999b-4fa8-8153-635d3455b6ce-kube-api-access-ts2qx\") pod \"d542cb54-999b-4fa8-8153-635d3455b6ce\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " Jul 08 19:41:27.541679 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.541561 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-console-config\") pod \"d542cb54-999b-4fa8-8153-635d3455b6ce\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " Jul 08 19:41:27.541679 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.541587 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-service-ca\") pod \"d542cb54-999b-4fa8-8153-635d3455b6ce\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " Jul 08 19:41:27.541679 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.541602 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-oauth-serving-cert\") pod \"d542cb54-999b-4fa8-8153-635d3455b6ce\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " Jul 08 19:41:27.541679 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.541627 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d542cb54-999b-4fa8-8153-635d3455b6ce-console-serving-cert\") pod \"d542cb54-999b-4fa8-8153-635d3455b6ce\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " Jul 08 19:41:27.541679 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.541652 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d542cb54-999b-4fa8-8153-635d3455b6ce-console-oauth-config\") pod \"d542cb54-999b-4fa8-8153-635d3455b6ce\" (UID: \"d542cb54-999b-4fa8-8153-635d3455b6ce\") " Jul 08 19:41:27.542540 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.542184 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d542cb54-999b-4fa8-8153-635d3455b6ce" (UID: "d542cb54-999b-4fa8-8153-635d3455b6ce"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:41:27.542540 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.542454 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-console-config" (OuterVolumeSpecName: "console-config") pod "d542cb54-999b-4fa8-8153-635d3455b6ce" (UID: "d542cb54-999b-4fa8-8153-635d3455b6ce"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:41:27.542540 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.542467 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d542cb54-999b-4fa8-8153-635d3455b6ce" (UID: "d542cb54-999b-4fa8-8153-635d3455b6ce"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:41:27.542540 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.542477 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-service-ca" (OuterVolumeSpecName: "service-ca") pod "d542cb54-999b-4fa8-8153-635d3455b6ce" (UID: "d542cb54-999b-4fa8-8153-635d3455b6ce"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:41:27.545979 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.543201 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-trusted-ca-bundle\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:41:27.545979 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.543229 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-console-config\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:41:27.545979 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.543254 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-service-ca\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:41:27.545979 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.543268 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d542cb54-999b-4fa8-8153-635d3455b6ce-oauth-serving-cert\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:41:27.545979 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.544666 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d542cb54-999b-4fa8-8153-635d3455b6ce-kube-api-access-ts2qx" (OuterVolumeSpecName: "kube-api-access-ts2qx") pod "d542cb54-999b-4fa8-8153-635d3455b6ce" (UID: "d542cb54-999b-4fa8-8153-635d3455b6ce"). InnerVolumeSpecName "kube-api-access-ts2qx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:41:27.545979 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.544909 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d542cb54-999b-4fa8-8153-635d3455b6ce-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d542cb54-999b-4fa8-8153-635d3455b6ce" (UID: "d542cb54-999b-4fa8-8153-635d3455b6ce"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:41:27.548222 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.546334 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d542cb54-999b-4fa8-8153-635d3455b6ce-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d542cb54-999b-4fa8-8153-635d3455b6ce" (UID: "d542cb54-999b-4fa8-8153-635d3455b6ce"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:41:27.643914 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.643889 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d542cb54-999b-4fa8-8153-635d3455b6ce-console-serving-cert\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:41:27.643914 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.643911 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d542cb54-999b-4fa8-8153-635d3455b6ce-console-oauth-config\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:41:27.643914 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:27.643920 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts2qx\" (UniqueName: \"kubernetes.io/projected/d542cb54-999b-4fa8-8153-635d3455b6ce-kube-api-access-ts2qx\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:41:28.187627 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:28.187590 2553 generic.go:356] "Generic (PLEG): container finished" podID="d542cb54-999b-4fa8-8153-635d3455b6ce" containerID="7841f546697092ce7365e0f9d30924d3d6e026d8667f5f32087effeae721031e" exitCode=0 Jul 08 19:41:28.188014 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:28.187655 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9ff676b-2852v" Jul 08 19:41:28.188014 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:28.187674 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9ff676b-2852v" event={"ID":"d542cb54-999b-4fa8-8153-635d3455b6ce","Type":"ContainerDied","Data":"7841f546697092ce7365e0f9d30924d3d6e026d8667f5f32087effeae721031e"} Jul 08 19:41:28.188014 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:28.187722 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9ff676b-2852v" event={"ID":"d542cb54-999b-4fa8-8153-635d3455b6ce","Type":"ContainerDied","Data":"1b5ab7539bde75c0097a99d38533a5c0eff3d528e83cb07cabd374ab515ff1d6"} Jul 08 19:41:28.188014 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:28.187742 2553 scope.go:117] "RemoveContainer" containerID="7841f546697092ce7365e0f9d30924d3d6e026d8667f5f32087effeae721031e" Jul 08 19:41:28.196377 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:28.196362 2553 scope.go:117] "RemoveContainer" containerID="7841f546697092ce7365e0f9d30924d3d6e026d8667f5f32087effeae721031e" Jul 08 19:41:28.196634 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:41:28.196617 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7841f546697092ce7365e0f9d30924d3d6e026d8667f5f32087effeae721031e\": container with ID starting with 7841f546697092ce7365e0f9d30924d3d6e026d8667f5f32087effeae721031e not found: ID does not exist" containerID="7841f546697092ce7365e0f9d30924d3d6e026d8667f5f32087effeae721031e" Jul 08 19:41:28.196683 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:28.196642 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7841f546697092ce7365e0f9d30924d3d6e026d8667f5f32087effeae721031e"} err="failed to get container status \"7841f546697092ce7365e0f9d30924d3d6e026d8667f5f32087effeae721031e\": rpc error: code = NotFound desc = could not find container \"7841f546697092ce7365e0f9d30924d3d6e026d8667f5f32087effeae721031e\": container with ID starting with 7841f546697092ce7365e0f9d30924d3d6e026d8667f5f32087effeae721031e not found: ID does not exist" Jul 08 19:41:28.208233 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:28.208212 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b9ff676b-2852v"] Jul 08 19:41:28.212324 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:28.212304 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b9ff676b-2852v"] Jul 08 19:41:28.776970 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:28.776939 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d542cb54-999b-4fa8-8153-635d3455b6ce" path="/var/lib/kubelet/pods/d542cb54-999b-4fa8-8153-635d3455b6ce/volumes" Jul 08 19:41:45.540798 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.540766 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj"] Jul 08 19:41:45.541166 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.541067 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d542cb54-999b-4fa8-8153-635d3455b6ce" containerName="console" Jul 08 19:41:45.541166 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.541078 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d542cb54-999b-4fa8-8153-635d3455b6ce" containerName="console" Jul 08 19:41:45.541166 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.541139 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d542cb54-999b-4fa8-8153-635d3455b6ce" containerName="console" Jul 08 19:41:45.543953 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.543931 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj" Jul 08 19:41:45.546625 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.546607 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 19:41:45.546724 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.546670 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 19:41:45.547733 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.547711 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bxknn\"" Jul 08 19:41:45.552976 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.552954 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj"] Jul 08 19:41:45.694225 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.694192 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4flrx\" (UniqueName: \"kubernetes.io/projected/5be4b564-f69d-42a4-81b9-c737226a08ba-kube-api-access-4flrx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj\" (UID: \"5be4b564-f69d-42a4-81b9-c737226a08ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj" Jul 08 19:41:45.694470 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.694260 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5be4b564-f69d-42a4-81b9-c737226a08ba-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj\" (UID: \"5be4b564-f69d-42a4-81b9-c737226a08ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj" Jul 08 19:41:45.694470 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.694342 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5be4b564-f69d-42a4-81b9-c737226a08ba-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj\" (UID: \"5be4b564-f69d-42a4-81b9-c737226a08ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj" Jul 08 19:41:45.795654 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.795577 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5be4b564-f69d-42a4-81b9-c737226a08ba-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj\" (UID: \"5be4b564-f69d-42a4-81b9-c737226a08ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj" Jul 08 19:41:45.795654 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.795627 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5be4b564-f69d-42a4-81b9-c737226a08ba-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj\" (UID: \"5be4b564-f69d-42a4-81b9-c737226a08ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj" Jul 08 19:41:45.795845 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.795670 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4flrx\" (UniqueName: \"kubernetes.io/projected/5be4b564-f69d-42a4-81b9-c737226a08ba-kube-api-access-4flrx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj\" (UID: \"5be4b564-f69d-42a4-81b9-c737226a08ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj" Jul 08 19:41:45.796015 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.795988 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5be4b564-f69d-42a4-81b9-c737226a08ba-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj\" (UID: \"5be4b564-f69d-42a4-81b9-c737226a08ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj" Jul 08 19:41:45.796077 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.796000 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5be4b564-f69d-42a4-81b9-c737226a08ba-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj\" (UID: \"5be4b564-f69d-42a4-81b9-c737226a08ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj" Jul 08 19:41:45.804828 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.804804 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4flrx\" (UniqueName: \"kubernetes.io/projected/5be4b564-f69d-42a4-81b9-c737226a08ba-kube-api-access-4flrx\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj\" (UID: \"5be4b564-f69d-42a4-81b9-c737226a08ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj" Jul 08 19:41:45.853235 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.853213 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj" Jul 08 19:41:45.982710 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:45.982682 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj"] Jul 08 19:41:45.984690 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:41:45.984664 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be4b564_f69d_42a4_81b9_c737226a08ba.slice/crio-4436e60991c7146a5f5fcc81288048df703d57905724125de6f8b965b1b62556 WatchSource:0}: Error finding container 4436e60991c7146a5f5fcc81288048df703d57905724125de6f8b965b1b62556: Status 404 returned error can't find the container with id 4436e60991c7146a5f5fcc81288048df703d57905724125de6f8b965b1b62556 Jul 08 19:41:46.260934 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:46.260847 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj" event={"ID":"5be4b564-f69d-42a4-81b9-c737226a08ba","Type":"ContainerStarted","Data":"4436e60991c7146a5f5fcc81288048df703d57905724125de6f8b965b1b62556"} Jul 08 19:41:54.298213 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:54.298175 2553 generic.go:356] "Generic (PLEG): container finished" podID="5be4b564-f69d-42a4-81b9-c737226a08ba" containerID="5754becc90654ca21bfcc4a840a56765538d06228acb7c4b3ce3ea61ae3d97bb" exitCode=0 Jul 08 19:41:54.298595 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:54.298269 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj" event={"ID":"5be4b564-f69d-42a4-81b9-c737226a08ba","Type":"ContainerDied","Data":"5754becc90654ca21bfcc4a840a56765538d06228acb7c4b3ce3ea61ae3d97bb"} Jul 08 19:41:57.314507 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:57.314474 2553 generic.go:356] "Generic (PLEG): container finished" podID="5be4b564-f69d-42a4-81b9-c737226a08ba" containerID="e5fbc3547bb439469ceaf40f6b8731c473067c7584654a33fe7fb8215637a79b" exitCode=0 Jul 08 19:41:57.314507 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:41:57.314512 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj" event={"ID":"5be4b564-f69d-42a4-81b9-c737226a08ba","Type":"ContainerDied","Data":"e5fbc3547bb439469ceaf40f6b8731c473067c7584654a33fe7fb8215637a79b"} Jul 08 19:42:05.349707 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:05.349671 2553 generic.go:356] "Generic (PLEG): container finished" podID="5be4b564-f69d-42a4-81b9-c737226a08ba" containerID="8857a3335557045718d3553a3836e480dc8f7007bce9239498aaf166f906bf7c" exitCode=0 Jul 08 19:42:05.350085 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:05.349724 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj" event={"ID":"5be4b564-f69d-42a4-81b9-c737226a08ba","Type":"ContainerDied","Data":"8857a3335557045718d3553a3836e480dc8f7007bce9239498aaf166f906bf7c"} Jul 08 19:42:06.474881 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:06.474858 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj" Jul 08 19:42:06.569239 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:06.569210 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4flrx\" (UniqueName: \"kubernetes.io/projected/5be4b564-f69d-42a4-81b9-c737226a08ba-kube-api-access-4flrx\") pod \"5be4b564-f69d-42a4-81b9-c737226a08ba\" (UID: \"5be4b564-f69d-42a4-81b9-c737226a08ba\") " Jul 08 19:42:06.569373 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:06.569258 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5be4b564-f69d-42a4-81b9-c737226a08ba-util\") pod \"5be4b564-f69d-42a4-81b9-c737226a08ba\" (UID: \"5be4b564-f69d-42a4-81b9-c737226a08ba\") " Jul 08 19:42:06.569373 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:06.569298 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5be4b564-f69d-42a4-81b9-c737226a08ba-bundle\") pod \"5be4b564-f69d-42a4-81b9-c737226a08ba\" (UID: \"5be4b564-f69d-42a4-81b9-c737226a08ba\") " Jul 08 19:42:06.570002 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:06.569974 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5be4b564-f69d-42a4-81b9-c737226a08ba-bundle" (OuterVolumeSpecName: "bundle") pod "5be4b564-f69d-42a4-81b9-c737226a08ba" (UID: "5be4b564-f69d-42a4-81b9-c737226a08ba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:42:06.571346 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:06.571322 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5be4b564-f69d-42a4-81b9-c737226a08ba-kube-api-access-4flrx" (OuterVolumeSpecName: "kube-api-access-4flrx") pod "5be4b564-f69d-42a4-81b9-c737226a08ba" (UID: "5be4b564-f69d-42a4-81b9-c737226a08ba"). InnerVolumeSpecName "kube-api-access-4flrx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:42:06.573752 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:06.573732 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5be4b564-f69d-42a4-81b9-c737226a08ba-util" (OuterVolumeSpecName: "util") pod "5be4b564-f69d-42a4-81b9-c737226a08ba" (UID: "5be4b564-f69d-42a4-81b9-c737226a08ba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:42:06.670919 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:06.670838 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5be4b564-f69d-42a4-81b9-c737226a08ba-bundle\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:42:06.670919 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:06.670867 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4flrx\" (UniqueName: \"kubernetes.io/projected/5be4b564-f69d-42a4-81b9-c737226a08ba-kube-api-access-4flrx\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:42:06.670919 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:06.670877 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5be4b564-f69d-42a4-81b9-c737226a08ba-util\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:42:07.359415 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:07.359382 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj" event={"ID":"5be4b564-f69d-42a4-81b9-c737226a08ba","Type":"ContainerDied","Data":"4436e60991c7146a5f5fcc81288048df703d57905724125de6f8b965b1b62556"} Jul 08 19:42:07.359593 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:07.359426 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4436e60991c7146a5f5fcc81288048df703d57905724125de6f8b965b1b62556" Jul 08 19:42:07.359593 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:07.359424 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540h7plj" Jul 08 19:42:14.091164 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.091126 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wvlnc"] Jul 08 19:42:14.092317 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.092293 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be4b564-f69d-42a4-81b9-c737226a08ba" containerName="extract" Jul 08 19:42:14.092474 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.092461 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be4b564-f69d-42a4-81b9-c737226a08ba" containerName="extract" Jul 08 19:42:14.092591 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.092580 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be4b564-f69d-42a4-81b9-c737226a08ba" containerName="pull" Jul 08 19:42:14.092666 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.092657 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be4b564-f69d-42a4-81b9-c737226a08ba" containerName="pull" Jul 08 19:42:14.092745 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.092736 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be4b564-f69d-42a4-81b9-c737226a08ba" containerName="util" Jul 08 19:42:14.092814 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.092806 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be4b564-f69d-42a4-81b9-c737226a08ba" containerName="util" Jul 08 19:42:14.093037 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.093026 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5be4b564-f69d-42a4-81b9-c737226a08ba" containerName="extract" Jul 08 19:42:14.118120 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.118093 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wvlnc"] Jul 08 19:42:14.118246 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.118183 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wvlnc" Jul 08 19:42:14.120792 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.120759 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:42:14.120898 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.120868 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 08 19:42:14.120898 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.120887 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-j7p42\"" Jul 08 19:42:14.233070 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.233037 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0f00f3b-dc3c-45ed-b700-6a164c6e84da-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wvlnc\" (UID: \"c0f00f3b-dc3c-45ed-b700-6a164c6e84da\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wvlnc" Jul 08 19:42:14.233244 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.233108 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9tzc\" (UniqueName: \"kubernetes.io/projected/c0f00f3b-dc3c-45ed-b700-6a164c6e84da-kube-api-access-p9tzc\") pod \"cert-manager-operator-controller-manager-55c444bf86-wvlnc\" (UID: \"c0f00f3b-dc3c-45ed-b700-6a164c6e84da\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wvlnc" Jul 08 19:42:14.333667 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.333626 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0f00f3b-dc3c-45ed-b700-6a164c6e84da-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wvlnc\" (UID: \"c0f00f3b-dc3c-45ed-b700-6a164c6e84da\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wvlnc" Jul 08 19:42:14.333836 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.333726 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9tzc\" (UniqueName: \"kubernetes.io/projected/c0f00f3b-dc3c-45ed-b700-6a164c6e84da-kube-api-access-p9tzc\") pod \"cert-manager-operator-controller-manager-55c444bf86-wvlnc\" (UID: \"c0f00f3b-dc3c-45ed-b700-6a164c6e84da\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wvlnc" Jul 08 19:42:14.334020 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.333988 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0f00f3b-dc3c-45ed-b700-6a164c6e84da-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wvlnc\" (UID: \"c0f00f3b-dc3c-45ed-b700-6a164c6e84da\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wvlnc" Jul 08 19:42:14.342178 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.342114 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9tzc\" (UniqueName: \"kubernetes.io/projected/c0f00f3b-dc3c-45ed-b700-6a164c6e84da-kube-api-access-p9tzc\") pod \"cert-manager-operator-controller-manager-55c444bf86-wvlnc\" (UID: \"c0f00f3b-dc3c-45ed-b700-6a164c6e84da\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wvlnc" Jul 08 19:42:14.427919 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.427834 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wvlnc" Jul 08 19:42:14.588175 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:14.588151 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wvlnc"] Jul 08 19:42:14.589295 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:42:14.589266 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0f00f3b_dc3c_45ed_b700_6a164c6e84da.slice/crio-e5e26a0178128858d7f7197bff92c3fa8ae54bbf9cdca7354c1a960b489e9588 WatchSource:0}: Error finding container e5e26a0178128858d7f7197bff92c3fa8ae54bbf9cdca7354c1a960b489e9588: Status 404 returned error can't find the container with id e5e26a0178128858d7f7197bff92c3fa8ae54bbf9cdca7354c1a960b489e9588 Jul 08 19:42:15.394536 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:15.394498 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wvlnc" event={"ID":"c0f00f3b-dc3c-45ed-b700-6a164c6e84da","Type":"ContainerStarted","Data":"e5e26a0178128858d7f7197bff92c3fa8ae54bbf9cdca7354c1a960b489e9588"} Jul 08 19:42:17.404370 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:17.404335 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wvlnc" event={"ID":"c0f00f3b-dc3c-45ed-b700-6a164c6e84da","Type":"ContainerStarted","Data":"c8431ed9e2329a4fd2615b093fd787e4a7eb9983ebad87dae1f89665abdd3a1b"} Jul 08 19:42:17.426767 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:17.426713 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wvlnc" podStartSLOduration=1.1789620570000001 podStartE2EDuration="3.426696966s" totalImagesPullingTime="2.247734909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:42:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:42:17.424412589 +0000 UTC m=+459.178056844" watchObservedRunningTime="2026-07-08 19:42:17.426696966 +0000 UTC m=+459.180341206" Jul 08 19:42:17.724131 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:17.724057 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-njk9x"] Jul 08 19:42:17.726917 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:17.726901 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-njk9x" Jul 08 19:42:17.729620 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:17.729598 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 08 19:42:17.729737 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:17.729659 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 08 19:42:17.729808 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:17.729734 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-qxrfw\"" Jul 08 19:42:17.739183 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:17.739165 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-njk9x"] Jul 08 19:42:17.862140 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:17.862107 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc9dp\" (UniqueName: \"kubernetes.io/projected/0969e212-6a98-4d92-89cf-c1d1a1a8a96a-kube-api-access-gc9dp\") pod \"cert-manager-webhook-6486ffd997-njk9x\" (UID: \"0969e212-6a98-4d92-89cf-c1d1a1a8a96a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-njk9x" Jul 08 19:42:17.862329 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:17.862185 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0969e212-6a98-4d92-89cf-c1d1a1a8a96a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-njk9x\" (UID: \"0969e212-6a98-4d92-89cf-c1d1a1a8a96a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-njk9x" Jul 08 19:42:17.962684 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:17.962657 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0969e212-6a98-4d92-89cf-c1d1a1a8a96a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-njk9x\" (UID: \"0969e212-6a98-4d92-89cf-c1d1a1a8a96a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-njk9x" Jul 08 19:42:17.962844 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:17.962736 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc9dp\" (UniqueName: \"kubernetes.io/projected/0969e212-6a98-4d92-89cf-c1d1a1a8a96a-kube-api-access-gc9dp\") pod \"cert-manager-webhook-6486ffd997-njk9x\" (UID: \"0969e212-6a98-4d92-89cf-c1d1a1a8a96a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-njk9x" Jul 08 19:42:17.986714 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:17.986647 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0969e212-6a98-4d92-89cf-c1d1a1a8a96a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-njk9x\" (UID: \"0969e212-6a98-4d92-89cf-c1d1a1a8a96a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-njk9x" Jul 08 19:42:17.990013 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:17.989988 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc9dp\" (UniqueName: \"kubernetes.io/projected/0969e212-6a98-4d92-89cf-c1d1a1a8a96a-kube-api-access-gc9dp\") pod \"cert-manager-webhook-6486ffd997-njk9x\" (UID: \"0969e212-6a98-4d92-89cf-c1d1a1a8a96a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-njk9x" Jul 08 19:42:18.044023 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.043998 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-njk9x" Jul 08 19:42:18.176133 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.176106 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-njk9x"] Jul 08 19:42:18.178577 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:42:18.178554 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0969e212_6a98_4d92_89cf_c1d1a1a8a96a.slice/crio-96e30c2eb336c7fc7f9cd418e629901e8dbc0b45fa39a77bdcabd6eda68d41f0 WatchSource:0}: Error finding container 96e30c2eb336c7fc7f9cd418e629901e8dbc0b45fa39a77bdcabd6eda68d41f0: Status 404 returned error can't find the container with id 96e30c2eb336c7fc7f9cd418e629901e8dbc0b45fa39a77bdcabd6eda68d41f0 Jul 08 19:42:18.410010 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.409980 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-njk9x" event={"ID":"0969e212-6a98-4d92-89cf-c1d1a1a8a96a","Type":"ContainerStarted","Data":"96e30c2eb336c7fc7f9cd418e629901e8dbc0b45fa39a77bdcabd6eda68d41f0"} Jul 08 19:42:18.555472 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.555425 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8"] Jul 08 19:42:18.558592 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.558571 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8" Jul 08 19:42:18.561107 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.561085 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bxknn\"" Jul 08 19:42:18.561243 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.561085 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 19:42:18.561243 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.561132 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 19:42:18.567530 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.567510 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8"] Jul 08 19:42:18.668551 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.668469 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsnzn\" (UniqueName: \"kubernetes.io/projected/419246c8-c8de-4e6f-9a94-2461bce33e9d-kube-api-access-wsnzn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8\" (UID: \"419246c8-c8de-4e6f-9a94-2461bce33e9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8" Jul 08 19:42:18.668551 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.668532 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/419246c8-c8de-4e6f-9a94-2461bce33e9d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8\" (UID: \"419246c8-c8de-4e6f-9a94-2461bce33e9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8" Jul 08 19:42:18.668740 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.668566 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/419246c8-c8de-4e6f-9a94-2461bce33e9d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8\" (UID: \"419246c8-c8de-4e6f-9a94-2461bce33e9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8" Jul 08 19:42:18.769912 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.769888 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/419246c8-c8de-4e6f-9a94-2461bce33e9d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8\" (UID: \"419246c8-c8de-4e6f-9a94-2461bce33e9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8" Jul 08 19:42:18.770072 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.769926 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/419246c8-c8de-4e6f-9a94-2461bce33e9d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8\" (UID: \"419246c8-c8de-4e6f-9a94-2461bce33e9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8" Jul 08 19:42:18.770072 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.769963 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsnzn\" (UniqueName: \"kubernetes.io/projected/419246c8-c8de-4e6f-9a94-2461bce33e9d-kube-api-access-wsnzn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8\" (UID: \"419246c8-c8de-4e6f-9a94-2461bce33e9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8" Jul 08 19:42:18.770335 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.770313 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/419246c8-c8de-4e6f-9a94-2461bce33e9d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8\" (UID: \"419246c8-c8de-4e6f-9a94-2461bce33e9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8" Jul 08 19:42:18.770410 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.770355 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/419246c8-c8de-4e6f-9a94-2461bce33e9d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8\" (UID: \"419246c8-c8de-4e6f-9a94-2461bce33e9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8" Jul 08 19:42:18.788679 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.788658 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsnzn\" (UniqueName: \"kubernetes.io/projected/419246c8-c8de-4e6f-9a94-2461bce33e9d-kube-api-access-wsnzn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8\" (UID: \"419246c8-c8de-4e6f-9a94-2461bce33e9d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8" Jul 08 19:42:18.869245 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:18.869210 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8" Jul 08 19:42:19.019970 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:19.019939 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8"] Jul 08 19:42:19.022539 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:42:19.022504 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419246c8_c8de_4e6f_9a94_2461bce33e9d.slice/crio-8712cb3f6bb94ab92fe092d424516bf0b3acd7e5288185403f2dc392fa3f2960 WatchSource:0}: Error finding container 8712cb3f6bb94ab92fe092d424516bf0b3acd7e5288185403f2dc392fa3f2960: Status 404 returned error can't find the container with id 8712cb3f6bb94ab92fe092d424516bf0b3acd7e5288185403f2dc392fa3f2960 Jul 08 19:42:19.415670 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:19.415635 2553 generic.go:356] "Generic (PLEG): container finished" podID="419246c8-c8de-4e6f-9a94-2461bce33e9d" containerID="efb17949caafe1e6575a01492b972a4be5dcaaa5365895030c3e709e6914d78a" exitCode=0 Jul 08 19:42:19.416146 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:19.415730 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8" event={"ID":"419246c8-c8de-4e6f-9a94-2461bce33e9d","Type":"ContainerDied","Data":"efb17949caafe1e6575a01492b972a4be5dcaaa5365895030c3e709e6914d78a"} Jul 08 19:42:19.416146 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:19.415799 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8" event={"ID":"419246c8-c8de-4e6f-9a94-2461bce33e9d","Type":"ContainerStarted","Data":"8712cb3f6bb94ab92fe092d424516bf0b3acd7e5288185403f2dc392fa3f2960"} Jul 08 19:42:20.550293 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:20.550259 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5dr97"] Jul 08 19:42:20.553084 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:20.553063 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dr97" Jul 08 19:42:20.555928 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:20.555909 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fv6xc\"" Jul 08 19:42:20.562820 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:20.561880 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5dr97"] Jul 08 19:42:20.688736 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:20.688673 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gptq8\" (UniqueName: \"kubernetes.io/projected/293965b8-afcb-4fa4-a6de-455e5a97ebee-kube-api-access-gptq8\") pod \"cert-manager-cainjector-559cdd8c87-5dr97\" (UID: \"293965b8-afcb-4fa4-a6de-455e5a97ebee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dr97" Jul 08 19:42:20.688923 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:20.688769 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/293965b8-afcb-4fa4-a6de-455e5a97ebee-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5dr97\" (UID: \"293965b8-afcb-4fa4-a6de-455e5a97ebee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dr97" Jul 08 19:42:20.789914 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:20.789872 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gptq8\" (UniqueName: \"kubernetes.io/projected/293965b8-afcb-4fa4-a6de-455e5a97ebee-kube-api-access-gptq8\") pod \"cert-manager-cainjector-559cdd8c87-5dr97\" (UID: \"293965b8-afcb-4fa4-a6de-455e5a97ebee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dr97" Jul 08 19:42:20.790094 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:20.789961 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/293965b8-afcb-4fa4-a6de-455e5a97ebee-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5dr97\" (UID: \"293965b8-afcb-4fa4-a6de-455e5a97ebee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dr97" Jul 08 19:42:20.799215 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:20.799179 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/293965b8-afcb-4fa4-a6de-455e5a97ebee-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5dr97\" (UID: \"293965b8-afcb-4fa4-a6de-455e5a97ebee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dr97" Jul 08 19:42:20.799450 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:20.799387 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gptq8\" (UniqueName: \"kubernetes.io/projected/293965b8-afcb-4fa4-a6de-455e5a97ebee-kube-api-access-gptq8\") pod \"cert-manager-cainjector-559cdd8c87-5dr97\" (UID: \"293965b8-afcb-4fa4-a6de-455e5a97ebee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dr97" Jul 08 19:42:20.865801 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:20.865730 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dr97" Jul 08 19:42:21.941344 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:21.941249 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5dr97"] Jul 08 19:42:21.944024 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:42:21.943979 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod293965b8_afcb_4fa4_a6de_455e5a97ebee.slice/crio-4ce527d3b57adbcc0af795bd8ccd6a9b4c43af4f42203b5b0204e60c4dc2deb2 WatchSource:0}: Error finding container 4ce527d3b57adbcc0af795bd8ccd6a9b4c43af4f42203b5b0204e60c4dc2deb2: Status 404 returned error can't find the container with id 4ce527d3b57adbcc0af795bd8ccd6a9b4c43af4f42203b5b0204e60c4dc2deb2 Jul 08 19:42:22.431629 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:22.431592 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-njk9x" event={"ID":"0969e212-6a98-4d92-89cf-c1d1a1a8a96a","Type":"ContainerStarted","Data":"b9878bcfea90391ea30e2d74ce5f228dadd3c3530a58883d072ba6ccf9e6791e"} Jul 08 19:42:22.431817 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:22.431750 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-njk9x" Jul 08 19:42:22.433132 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:22.433102 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dr97" event={"ID":"293965b8-afcb-4fa4-a6de-455e5a97ebee","Type":"ContainerStarted","Data":"c57750dd13c867554a8e7aea0d98b63127853540a2646081dd28a469a3643fb5"} Jul 08 19:42:22.433257 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:22.433144 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dr97" event={"ID":"293965b8-afcb-4fa4-a6de-455e5a97ebee","Type":"ContainerStarted","Data":"4ce527d3b57adbcc0af795bd8ccd6a9b4c43af4f42203b5b0204e60c4dc2deb2"} Jul 08 19:42:22.434912 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:22.434888 2553 generic.go:356] "Generic (PLEG): container finished" podID="419246c8-c8de-4e6f-9a94-2461bce33e9d" containerID="213a60dd29e895d5f93a4ea9a96c0f22f8eac01b3f7720ca2db098133a1901dd" exitCode=0 Jul 08 19:42:22.435008 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:22.434964 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8" event={"ID":"419246c8-c8de-4e6f-9a94-2461bce33e9d","Type":"ContainerDied","Data":"213a60dd29e895d5f93a4ea9a96c0f22f8eac01b3f7720ca2db098133a1901dd"} Jul 08 19:42:22.465302 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:22.465250 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-njk9x" podStartSLOduration=1.810483767 podStartE2EDuration="5.465232438s" totalImagesPullingTime="3.654748671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:42:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:42:22.447667687 +0000 UTC m=+464.201311959" watchObservedRunningTime="2026-07-08 19:42:22.465232438 +0000 UTC m=+464.218876683" Jul 08 19:42:22.480787 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:22.480748 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5dr97" podStartSLOduration=2.480737046 podStartE2EDuration="2.480737046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:42:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:42:22.480099148 +0000 UTC m=+464.233743417" watchObservedRunningTime="2026-07-08 19:42:22.480737046 +0000 UTC m=+464.234381288" Jul 08 19:42:23.442100 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:23.442066 2553 generic.go:356] "Generic (PLEG): container finished" podID="419246c8-c8de-4e6f-9a94-2461bce33e9d" containerID="7a88fe9587ce4bdd4f4dfa1b1263e08720145af70cbed60876cebede5a15eb45" exitCode=0 Jul 08 19:42:23.442543 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:23.442155 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8" event={"ID":"419246c8-c8de-4e6f-9a94-2461bce33e9d","Type":"ContainerDied","Data":"7a88fe9587ce4bdd4f4dfa1b1263e08720145af70cbed60876cebede5a15eb45"} Jul 08 19:42:24.577278 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:24.577257 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8" Jul 08 19:42:24.725586 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:24.725514 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsnzn\" (UniqueName: \"kubernetes.io/projected/419246c8-c8de-4e6f-9a94-2461bce33e9d-kube-api-access-wsnzn\") pod \"419246c8-c8de-4e6f-9a94-2461bce33e9d\" (UID: \"419246c8-c8de-4e6f-9a94-2461bce33e9d\") " Jul 08 19:42:24.725586 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:24.725557 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/419246c8-c8de-4e6f-9a94-2461bce33e9d-bundle\") pod \"419246c8-c8de-4e6f-9a94-2461bce33e9d\" (UID: \"419246c8-c8de-4e6f-9a94-2461bce33e9d\") " Jul 08 19:42:24.725776 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:24.725615 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/419246c8-c8de-4e6f-9a94-2461bce33e9d-util\") pod \"419246c8-c8de-4e6f-9a94-2461bce33e9d\" (UID: \"419246c8-c8de-4e6f-9a94-2461bce33e9d\") " Jul 08 19:42:24.725981 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:24.725958 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/419246c8-c8de-4e6f-9a94-2461bce33e9d-bundle" (OuterVolumeSpecName: "bundle") pod "419246c8-c8de-4e6f-9a94-2461bce33e9d" (UID: "419246c8-c8de-4e6f-9a94-2461bce33e9d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:42:24.727471 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:24.727450 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/419246c8-c8de-4e6f-9a94-2461bce33e9d-kube-api-access-wsnzn" (OuterVolumeSpecName: "kube-api-access-wsnzn") pod "419246c8-c8de-4e6f-9a94-2461bce33e9d" (UID: "419246c8-c8de-4e6f-9a94-2461bce33e9d"). InnerVolumeSpecName "kube-api-access-wsnzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:42:24.729800 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:24.729780 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/419246c8-c8de-4e6f-9a94-2461bce33e9d-util" (OuterVolumeSpecName: "util") pod "419246c8-c8de-4e6f-9a94-2461bce33e9d" (UID: "419246c8-c8de-4e6f-9a94-2461bce33e9d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:42:24.826383 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:24.826361 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsnzn\" (UniqueName: \"kubernetes.io/projected/419246c8-c8de-4e6f-9a94-2461bce33e9d-kube-api-access-wsnzn\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:42:24.826383 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:24.826384 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/419246c8-c8de-4e6f-9a94-2461bce33e9d-bundle\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:42:24.826529 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:24.826395 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/419246c8-c8de-4e6f-9a94-2461bce33e9d-util\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:42:25.453452 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:25.453411 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8" event={"ID":"419246c8-c8de-4e6f-9a94-2461bce33e9d","Type":"ContainerDied","Data":"8712cb3f6bb94ab92fe092d424516bf0b3acd7e5288185403f2dc392fa3f2960"} Jul 08 19:42:25.453634 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:25.453521 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8712cb3f6bb94ab92fe092d424516bf0b3acd7e5288185403f2dc392fa3f2960" Jul 08 19:42:25.453634 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:25.453425 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594h8" Jul 08 19:42:28.444987 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:28.444958 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-njk9x" Jul 08 19:42:31.173742 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.173710 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f9xbl"] Jul 08 19:42:31.174096 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.174016 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="419246c8-c8de-4e6f-9a94-2461bce33e9d" containerName="extract" Jul 08 19:42:31.174096 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.174027 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="419246c8-c8de-4e6f-9a94-2461bce33e9d" containerName="extract" Jul 08 19:42:31.174096 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.174045 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="419246c8-c8de-4e6f-9a94-2461bce33e9d" containerName="util" Jul 08 19:42:31.174096 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.174050 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="419246c8-c8de-4e6f-9a94-2461bce33e9d" containerName="util" Jul 08 19:42:31.174096 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.174059 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="419246c8-c8de-4e6f-9a94-2461bce33e9d" containerName="pull" Jul 08 19:42:31.174096 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.174064 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="419246c8-c8de-4e6f-9a94-2461bce33e9d" containerName="pull" Jul 08 19:42:31.174285 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.174126 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="419246c8-c8de-4e6f-9a94-2461bce33e9d" containerName="extract" Jul 08 19:42:31.176214 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.176197 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f9xbl" Jul 08 19:42:31.178970 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.178946 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:42:31.179829 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.179809 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 19:42:31.179829 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.179818 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-h74ll\"" Jul 08 19:42:31.187650 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.187632 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f9xbl"] Jul 08 19:42:31.282609 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.282583 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62775367-44c7-49c6-8498-e231d49778b4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f9xbl\" (UID: \"62775367-44c7-49c6-8498-e231d49778b4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f9xbl" Jul 08 19:42:31.282711 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.282621 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dltr2\" (UniqueName: \"kubernetes.io/projected/62775367-44c7-49c6-8498-e231d49778b4-kube-api-access-dltr2\") pod \"openshift-lws-operator-fd8ccff4c-f9xbl\" (UID: \"62775367-44c7-49c6-8498-e231d49778b4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f9xbl" Jul 08 19:42:31.383795 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.383760 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62775367-44c7-49c6-8498-e231d49778b4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f9xbl\" (UID: \"62775367-44c7-49c6-8498-e231d49778b4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f9xbl" Jul 08 19:42:31.383973 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.383808 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dltr2\" (UniqueName: \"kubernetes.io/projected/62775367-44c7-49c6-8498-e231d49778b4-kube-api-access-dltr2\") pod \"openshift-lws-operator-fd8ccff4c-f9xbl\" (UID: \"62775367-44c7-49c6-8498-e231d49778b4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f9xbl" Jul 08 19:42:31.384178 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.384156 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62775367-44c7-49c6-8498-e231d49778b4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f9xbl\" (UID: \"62775367-44c7-49c6-8498-e231d49778b4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f9xbl" Jul 08 19:42:31.392195 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.392170 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dltr2\" (UniqueName: \"kubernetes.io/projected/62775367-44c7-49c6-8498-e231d49778b4-kube-api-access-dltr2\") pod \"openshift-lws-operator-fd8ccff4c-f9xbl\" (UID: \"62775367-44c7-49c6-8498-e231d49778b4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f9xbl" Jul 08 19:42:31.485241 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.485154 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f9xbl" Jul 08 19:42:31.609270 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:31.609247 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f9xbl"] Jul 08 19:42:31.611002 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:42:31.610976 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62775367_44c7_49c6_8498_e231d49778b4.slice/crio-c541087de10fb01776a6c2b318e134288f8d963a1e5855824e67cc0e11a7c176 WatchSource:0}: Error finding container c541087de10fb01776a6c2b318e134288f8d963a1e5855824e67cc0e11a7c176: Status 404 returned error can't find the container with id c541087de10fb01776a6c2b318e134288f8d963a1e5855824e67cc0e11a7c176 Jul 08 19:42:32.488015 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:32.487977 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f9xbl" event={"ID":"62775367-44c7-49c6-8498-e231d49778b4","Type":"ContainerStarted","Data":"c541087de10fb01776a6c2b318e134288f8d963a1e5855824e67cc0e11a7c176"} Jul 08 19:42:34.500034 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:34.500003 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f9xbl" event={"ID":"62775367-44c7-49c6-8498-e231d49778b4","Type":"ContainerStarted","Data":"c032751ee8d0d2f7fddef6c007707cbb50e8342257829a05d84985fe84df9327"} Jul 08 19:42:34.516676 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:34.516629 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f9xbl" podStartSLOduration=1.637953704 podStartE2EDuration="3.516615265s" totalImagesPullingTime="1.878661561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:42:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:42:34.515382473 +0000 UTC m=+476.269026716" watchObservedRunningTime="2026-07-08 19:42:34.516615265 +0000 UTC m=+476.270259506" Jul 08 19:42:37.232279 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:37.232242 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv"] Jul 08 19:42:37.234793 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:37.234776 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv" Jul 08 19:42:37.237544 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:37.237523 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 19:42:37.237631 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:37.237550 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 19:42:37.238745 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:37.238725 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bxknn\"" Jul 08 19:42:37.245006 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:37.244986 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv"] Jul 08 19:42:37.331305 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:37.331276 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f674fd85-16c7-4c5d-9561-477c22d2d7c3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv\" (UID: \"f674fd85-16c7-4c5d-9561-477c22d2d7c3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv" Jul 08 19:42:37.331498 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:37.331355 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f674fd85-16c7-4c5d-9561-477c22d2d7c3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv\" (UID: \"f674fd85-16c7-4c5d-9561-477c22d2d7c3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv" Jul 08 19:42:37.331498 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:37.331375 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5snrv\" (UniqueName: \"kubernetes.io/projected/f674fd85-16c7-4c5d-9561-477c22d2d7c3-kube-api-access-5snrv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv\" (UID: \"f674fd85-16c7-4c5d-9561-477c22d2d7c3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv" Jul 08 19:42:37.431966 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:37.431939 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f674fd85-16c7-4c5d-9561-477c22d2d7c3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv\" (UID: \"f674fd85-16c7-4c5d-9561-477c22d2d7c3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv" Jul 08 19:42:37.431966 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:37.431967 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5snrv\" (UniqueName: \"kubernetes.io/projected/f674fd85-16c7-4c5d-9561-477c22d2d7c3-kube-api-access-5snrv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv\" (UID: \"f674fd85-16c7-4c5d-9561-477c22d2d7c3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv" Jul 08 19:42:37.432114 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:37.432006 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f674fd85-16c7-4c5d-9561-477c22d2d7c3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv\" (UID: \"f674fd85-16c7-4c5d-9561-477c22d2d7c3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv" Jul 08 19:42:37.432334 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:37.432309 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f674fd85-16c7-4c5d-9561-477c22d2d7c3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv\" (UID: \"f674fd85-16c7-4c5d-9561-477c22d2d7c3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv" Jul 08 19:42:37.432334 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:37.432327 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f674fd85-16c7-4c5d-9561-477c22d2d7c3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv\" (UID: \"f674fd85-16c7-4c5d-9561-477c22d2d7c3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv" Jul 08 19:42:37.440232 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:37.440206 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5snrv\" (UniqueName: \"kubernetes.io/projected/f674fd85-16c7-4c5d-9561-477c22d2d7c3-kube-api-access-5snrv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv\" (UID: \"f674fd85-16c7-4c5d-9561-477c22d2d7c3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv" Jul 08 19:42:37.544647 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:37.544619 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv" Jul 08 19:42:37.673863 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:37.673839 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv"] Jul 08 19:42:37.675247 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:42:37.675216 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf674fd85_16c7_4c5d_9561_477c22d2d7c3.slice/crio-56a009460562df5c16de0b287cc3ecaf83aeb6c48bf655580a48f93bc64de407 WatchSource:0}: Error finding container 56a009460562df5c16de0b287cc3ecaf83aeb6c48bf655580a48f93bc64de407: Status 404 returned error can't find the container with id 56a009460562df5c16de0b287cc3ecaf83aeb6c48bf655580a48f93bc64de407 Jul 08 19:42:38.519606 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:38.519572 2553 generic.go:356] "Generic (PLEG): container finished" podID="f674fd85-16c7-4c5d-9561-477c22d2d7c3" containerID="1f36479a490c1f190145c38405bc0b6426e8018942cef2e1c2c0bd81c6d768ae" exitCode=0 Jul 08 19:42:38.519945 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:38.519630 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv" event={"ID":"f674fd85-16c7-4c5d-9561-477c22d2d7c3","Type":"ContainerDied","Data":"1f36479a490c1f190145c38405bc0b6426e8018942cef2e1c2c0bd81c6d768ae"} Jul 08 19:42:38.519945 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:38.519709 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv" event={"ID":"f674fd85-16c7-4c5d-9561-477c22d2d7c3","Type":"ContainerStarted","Data":"56a009460562df5c16de0b287cc3ecaf83aeb6c48bf655580a48f93bc64de407"} Jul 08 19:42:39.525968 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:39.525889 2553 generic.go:356] "Generic (PLEG): container finished" podID="f674fd85-16c7-4c5d-9561-477c22d2d7c3" containerID="9dda31eef0df893136b11edaf289c8ee87c2b3235a6e4edccbfaffe8ee87f788" exitCode=0 Jul 08 19:42:39.525968 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:39.525943 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv" event={"ID":"f674fd85-16c7-4c5d-9561-477c22d2d7c3","Type":"ContainerDied","Data":"9dda31eef0df893136b11edaf289c8ee87c2b3235a6e4edccbfaffe8ee87f788"} Jul 08 19:42:40.532690 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:40.532654 2553 generic.go:356] "Generic (PLEG): container finished" podID="f674fd85-16c7-4c5d-9561-477c22d2d7c3" containerID="e8170b9dafb5afbef2523f13aeb95c4d54c70551d47ac942da2ced218227111b" exitCode=0 Jul 08 19:42:40.533050 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:40.532729 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv" event={"ID":"f674fd85-16c7-4c5d-9561-477c22d2d7c3","Type":"ContainerDied","Data":"e8170b9dafb5afbef2523f13aeb95c4d54c70551d47ac942da2ced218227111b"} Jul 08 19:42:41.686118 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:41.686090 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv" Jul 08 19:42:41.865751 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:41.865668 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f674fd85-16c7-4c5d-9561-477c22d2d7c3-bundle\") pod \"f674fd85-16c7-4c5d-9561-477c22d2d7c3\" (UID: \"f674fd85-16c7-4c5d-9561-477c22d2d7c3\") " Jul 08 19:42:41.865751 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:41.865738 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f674fd85-16c7-4c5d-9561-477c22d2d7c3-util\") pod \"f674fd85-16c7-4c5d-9561-477c22d2d7c3\" (UID: \"f674fd85-16c7-4c5d-9561-477c22d2d7c3\") " Jul 08 19:42:41.865952 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:41.865787 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5snrv\" (UniqueName: \"kubernetes.io/projected/f674fd85-16c7-4c5d-9561-477c22d2d7c3-kube-api-access-5snrv\") pod \"f674fd85-16c7-4c5d-9561-477c22d2d7c3\" (UID: \"f674fd85-16c7-4c5d-9561-477c22d2d7c3\") " Jul 08 19:42:41.866377 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:41.866347 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f674fd85-16c7-4c5d-9561-477c22d2d7c3-bundle" (OuterVolumeSpecName: "bundle") pod "f674fd85-16c7-4c5d-9561-477c22d2d7c3" (UID: "f674fd85-16c7-4c5d-9561-477c22d2d7c3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:42:41.867799 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:41.867778 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f674fd85-16c7-4c5d-9561-477c22d2d7c3-kube-api-access-5snrv" (OuterVolumeSpecName: "kube-api-access-5snrv") pod "f674fd85-16c7-4c5d-9561-477c22d2d7c3" (UID: "f674fd85-16c7-4c5d-9561-477c22d2d7c3"). InnerVolumeSpecName "kube-api-access-5snrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:42:41.871206 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:41.871185 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f674fd85-16c7-4c5d-9561-477c22d2d7c3-util" (OuterVolumeSpecName: "util") pod "f674fd85-16c7-4c5d-9561-477c22d2d7c3" (UID: "f674fd85-16c7-4c5d-9561-477c22d2d7c3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:42:41.967003 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:41.966961 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f674fd85-16c7-4c5d-9561-477c22d2d7c3-bundle\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:42:41.967003 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:41.966997 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f674fd85-16c7-4c5d-9561-477c22d2d7c3-util\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:42:41.967003 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:41.967006 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5snrv\" (UniqueName: \"kubernetes.io/projected/f674fd85-16c7-4c5d-9561-477c22d2d7c3-kube-api-access-5snrv\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:42:42.544040 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:42.544014 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv" Jul 08 19:42:42.544200 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:42.544047 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afnrsfv" event={"ID":"f674fd85-16c7-4c5d-9561-477c22d2d7c3","Type":"ContainerDied","Data":"56a009460562df5c16de0b287cc3ecaf83aeb6c48bf655580a48f93bc64de407"} Jul 08 19:42:42.544200 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:42.544088 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56a009460562df5c16de0b287cc3ecaf83aeb6c48bf655580a48f93bc64de407" Jul 08 19:42:55.147550 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.147513 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz"] Jul 08 19:42:55.148039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.147878 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f674fd85-16c7-4c5d-9561-477c22d2d7c3" containerName="pull" Jul 08 19:42:55.148039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.147892 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f674fd85-16c7-4c5d-9561-477c22d2d7c3" containerName="pull" Jul 08 19:42:55.148039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.147910 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f674fd85-16c7-4c5d-9561-477c22d2d7c3" containerName="util" Jul 08 19:42:55.148039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.147916 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f674fd85-16c7-4c5d-9561-477c22d2d7c3" containerName="util" Jul 08 19:42:55.148039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.147928 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f674fd85-16c7-4c5d-9561-477c22d2d7c3" containerName="extract" Jul 08 19:42:55.148039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.147937 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f674fd85-16c7-4c5d-9561-477c22d2d7c3" containerName="extract" Jul 08 19:42:55.148039 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.147997 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f674fd85-16c7-4c5d-9561-477c22d2d7c3" containerName="extract" Jul 08 19:42:55.189963 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.189933 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz"] Jul 08 19:42:55.190102 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.190035 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:42:55.192973 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.192951 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 19:42:55.193092 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.192974 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 19:42:55.193092 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.192996 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lwpjc\"" Jul 08 19:42:55.193189 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.193151 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 19:42:55.193427 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.193407 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 19:42:55.265054 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.265024 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2f53743-d6ba-4922-93fb-0d9d106f603e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d8f46d496-5wllz\" (UID: \"b2f53743-d6ba-4922-93fb-0d9d106f603e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:42:55.265208 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.265085 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nddbj\" (UniqueName: \"kubernetes.io/projected/b2f53743-d6ba-4922-93fb-0d9d106f603e-kube-api-access-nddbj\") pod \"opendatahub-operator-controller-manager-5d8f46d496-5wllz\" (UID: \"b2f53743-d6ba-4922-93fb-0d9d106f603e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:42:55.265208 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.265158 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b2f53743-d6ba-4922-93fb-0d9d106f603e-manifests\") pod \"opendatahub-operator-controller-manager-5d8f46d496-5wllz\" (UID: \"b2f53743-d6ba-4922-93fb-0d9d106f603e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:42:55.265208 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.265192 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2f53743-d6ba-4922-93fb-0d9d106f603e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d8f46d496-5wllz\" (UID: \"b2f53743-d6ba-4922-93fb-0d9d106f603e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:42:55.265363 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.265258 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2f53743-d6ba-4922-93fb-0d9d106f603e-tmp\") pod \"opendatahub-operator-controller-manager-5d8f46d496-5wllz\" (UID: \"b2f53743-d6ba-4922-93fb-0d9d106f603e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:42:55.366176 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.366147 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2f53743-d6ba-4922-93fb-0d9d106f603e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d8f46d496-5wllz\" (UID: \"b2f53743-d6ba-4922-93fb-0d9d106f603e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:42:55.366341 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.366195 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nddbj\" (UniqueName: \"kubernetes.io/projected/b2f53743-d6ba-4922-93fb-0d9d106f603e-kube-api-access-nddbj\") pod \"opendatahub-operator-controller-manager-5d8f46d496-5wllz\" (UID: \"b2f53743-d6ba-4922-93fb-0d9d106f603e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:42:55.366341 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.366223 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b2f53743-d6ba-4922-93fb-0d9d106f603e-manifests\") pod \"opendatahub-operator-controller-manager-5d8f46d496-5wllz\" (UID: \"b2f53743-d6ba-4922-93fb-0d9d106f603e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:42:55.366341 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.366248 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2f53743-d6ba-4922-93fb-0d9d106f603e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d8f46d496-5wllz\" (UID: \"b2f53743-d6ba-4922-93fb-0d9d106f603e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:42:55.366341 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.366284 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2f53743-d6ba-4922-93fb-0d9d106f603e-tmp\") pod \"opendatahub-operator-controller-manager-5d8f46d496-5wllz\" (UID: \"b2f53743-d6ba-4922-93fb-0d9d106f603e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:42:55.366724 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.366704 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b2f53743-d6ba-4922-93fb-0d9d106f603e-manifests\") pod \"opendatahub-operator-controller-manager-5d8f46d496-5wllz\" (UID: \"b2f53743-d6ba-4922-93fb-0d9d106f603e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:42:55.368538 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.368516 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2f53743-d6ba-4922-93fb-0d9d106f603e-tmp\") pod \"opendatahub-operator-controller-manager-5d8f46d496-5wllz\" (UID: \"b2f53743-d6ba-4922-93fb-0d9d106f603e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:42:55.368868 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.368849 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2f53743-d6ba-4922-93fb-0d9d106f603e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d8f46d496-5wllz\" (UID: \"b2f53743-d6ba-4922-93fb-0d9d106f603e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:42:55.368912 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.368849 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2f53743-d6ba-4922-93fb-0d9d106f603e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d8f46d496-5wllz\" (UID: \"b2f53743-d6ba-4922-93fb-0d9d106f603e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:42:55.376409 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.376384 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nddbj\" (UniqueName: \"kubernetes.io/projected/b2f53743-d6ba-4922-93fb-0d9d106f603e-kube-api-access-nddbj\") pod \"opendatahub-operator-controller-manager-5d8f46d496-5wllz\" (UID: \"b2f53743-d6ba-4922-93fb-0d9d106f603e\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:42:55.500231 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.500153 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:42:55.643301 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:55.643273 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz"] Jul 08 19:42:55.647816 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:42:55.647789 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f53743_d6ba_4922_93fb_0d9d106f603e.slice/crio-16e1d783d7f3108f5526a9b8f44c8294127c1f6ee14f9357c2ff9d236a88a2bd WatchSource:0}: Error finding container 16e1d783d7f3108f5526a9b8f44c8294127c1f6ee14f9357c2ff9d236a88a2bd: Status 404 returned error can't find the container with id 16e1d783d7f3108f5526a9b8f44c8294127c1f6ee14f9357c2ff9d236a88a2bd Jul 08 19:42:56.622702 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:56.622664 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" event={"ID":"b2f53743-d6ba-4922-93fb-0d9d106f603e","Type":"ContainerStarted","Data":"16e1d783d7f3108f5526a9b8f44c8294127c1f6ee14f9357c2ff9d236a88a2bd"} Jul 08 19:42:59.640121 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:42:59.640075 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" event={"ID":"b2f53743-d6ba-4922-93fb-0d9d106f603e","Type":"ContainerStarted","Data":"f308633a7fe534482992fdd6c0f1def2de79001d1d6d4ea96a6b936bad90c710"} Jul 08 19:43:00.646874 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:00.646836 2553 generic.go:356] "Generic (PLEG): container finished" podID="b2f53743-d6ba-4922-93fb-0d9d106f603e" containerID="f308633a7fe534482992fdd6c0f1def2de79001d1d6d4ea96a6b936bad90c710" exitCode=0 Jul 08 19:43:00.647250 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:00.646920 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" event={"ID":"b2f53743-d6ba-4922-93fb-0d9d106f603e","Type":"ContainerDied","Data":"f308633a7fe534482992fdd6c0f1def2de79001d1d6d4ea96a6b936bad90c710"} Jul 08 19:43:01.654224 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:01.654192 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" event={"ID":"b2f53743-d6ba-4922-93fb-0d9d106f603e","Type":"ContainerStarted","Data":"2a99ff9d079378adae7a6c81a4fa8531fb08e9070a3db314166aa2c4ba0488e7"} Jul 08 19:43:01.654628 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:01.654316 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:43:01.682142 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:01.682091 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" podStartSLOduration=2.36313634 podStartE2EDuration="6.682075114s" totalImagesPullingTime="3.253897902s" totalInitContainerRuntime="1.065040872s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:42:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:43:01.680095876 +0000 UTC m=+503.433740145" watchObservedRunningTime="2026-07-08 19:43:01.682075114 +0000 UTC m=+503.435719607" Jul 08 19:43:12.661111 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:12.661082 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d8f46d496-5wllz" Jul 08 19:43:15.239698 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.239667 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-769fbf6cd9-q6nks"] Jul 08 19:43:15.245417 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.245395 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-769fbf6cd9-q6nks" Jul 08 19:43:15.248481 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.248456 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 19:43:15.248610 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.248566 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 08 19:43:15.248678 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.248632 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 19:43:15.249796 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.249781 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2vc2w\"" Jul 08 19:43:15.249874 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.249800 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 08 19:43:15.258109 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.258087 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-769fbf6cd9-q6nks"] Jul 08 19:43:15.330097 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.330070 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e45aa04-75ad-4665-8a03-0eaca2f5f7e5-tls-certs\") pod \"kube-auth-proxy-769fbf6cd9-q6nks\" (UID: \"1e45aa04-75ad-4665-8a03-0eaca2f5f7e5\") " pod="openshift-ingress/kube-auth-proxy-769fbf6cd9-q6nks" Jul 08 19:43:15.330227 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.330100 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j694g\" (UniqueName: \"kubernetes.io/projected/1e45aa04-75ad-4665-8a03-0eaca2f5f7e5-kube-api-access-j694g\") pod \"kube-auth-proxy-769fbf6cd9-q6nks\" (UID: \"1e45aa04-75ad-4665-8a03-0eaca2f5f7e5\") " pod="openshift-ingress/kube-auth-proxy-769fbf6cd9-q6nks" Jul 08 19:43:15.330227 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.330190 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e45aa04-75ad-4665-8a03-0eaca2f5f7e5-tmp\") pod \"kube-auth-proxy-769fbf6cd9-q6nks\" (UID: \"1e45aa04-75ad-4665-8a03-0eaca2f5f7e5\") " pod="openshift-ingress/kube-auth-proxy-769fbf6cd9-q6nks" Jul 08 19:43:15.430571 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.430541 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e45aa04-75ad-4665-8a03-0eaca2f5f7e5-tmp\") pod \"kube-auth-proxy-769fbf6cd9-q6nks\" (UID: \"1e45aa04-75ad-4665-8a03-0eaca2f5f7e5\") " pod="openshift-ingress/kube-auth-proxy-769fbf6cd9-q6nks" Jul 08 19:43:15.430700 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.430577 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e45aa04-75ad-4665-8a03-0eaca2f5f7e5-tls-certs\") pod \"kube-auth-proxy-769fbf6cd9-q6nks\" (UID: \"1e45aa04-75ad-4665-8a03-0eaca2f5f7e5\") " pod="openshift-ingress/kube-auth-proxy-769fbf6cd9-q6nks" Jul 08 19:43:15.430700 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.430593 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j694g\" (UniqueName: \"kubernetes.io/projected/1e45aa04-75ad-4665-8a03-0eaca2f5f7e5-kube-api-access-j694g\") pod \"kube-auth-proxy-769fbf6cd9-q6nks\" (UID: \"1e45aa04-75ad-4665-8a03-0eaca2f5f7e5\") " pod="openshift-ingress/kube-auth-proxy-769fbf6cd9-q6nks" Jul 08 19:43:15.432699 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.432672 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e45aa04-75ad-4665-8a03-0eaca2f5f7e5-tmp\") pod \"kube-auth-proxy-769fbf6cd9-q6nks\" (UID: \"1e45aa04-75ad-4665-8a03-0eaca2f5f7e5\") " pod="openshift-ingress/kube-auth-proxy-769fbf6cd9-q6nks" Jul 08 19:43:15.432947 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.432930 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e45aa04-75ad-4665-8a03-0eaca2f5f7e5-tls-certs\") pod \"kube-auth-proxy-769fbf6cd9-q6nks\" (UID: \"1e45aa04-75ad-4665-8a03-0eaca2f5f7e5\") " pod="openshift-ingress/kube-auth-proxy-769fbf6cd9-q6nks" Jul 08 19:43:15.440607 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.440586 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j694g\" (UniqueName: \"kubernetes.io/projected/1e45aa04-75ad-4665-8a03-0eaca2f5f7e5-kube-api-access-j694g\") pod \"kube-auth-proxy-769fbf6cd9-q6nks\" (UID: \"1e45aa04-75ad-4665-8a03-0eaca2f5f7e5\") " pod="openshift-ingress/kube-auth-proxy-769fbf6cd9-q6nks" Jul 08 19:43:15.555456 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.555404 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-769fbf6cd9-q6nks" Jul 08 19:43:15.691315 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.691291 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-769fbf6cd9-q6nks"] Jul 08 19:43:15.693333 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:43:15.693307 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e45aa04_75ad_4665_8a03_0eaca2f5f7e5.slice/crio-53b0e4f235ef7e32a6eb5902d58557a7bfe21232e1cf4f8898cd33596a3d99ec WatchSource:0}: Error finding container 53b0e4f235ef7e32a6eb5902d58557a7bfe21232e1cf4f8898cd33596a3d99ec: Status 404 returned error can't find the container with id 53b0e4f235ef7e32a6eb5902d58557a7bfe21232e1cf4f8898cd33596a3d99ec Jul 08 19:43:15.723688 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:15.723649 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-769fbf6cd9-q6nks" event={"ID":"1e45aa04-75ad-4665-8a03-0eaca2f5f7e5","Type":"ContainerStarted","Data":"53b0e4f235ef7e32a6eb5902d58557a7bfe21232e1cf4f8898cd33596a3d99ec"} Jul 08 19:43:16.369998 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:16.369958 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6nkzw"] Jul 08 19:43:16.373052 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:16.373033 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6nkzw" Jul 08 19:43:16.376190 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:16.376170 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 08 19:43:16.394578 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:16.394556 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6nkzw"] Jul 08 19:43:16.438793 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:16.438762 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfaae64-1d23-4079-85de-be74aef93262-tls-certs\") pod \"model-serving-api-54d89bd5fc-6nkzw\" (UID: \"6cfaae64-1d23-4079-85de-be74aef93262\") " pod="opendatahub/model-serving-api-54d89bd5fc-6nkzw" Jul 08 19:43:16.438913 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:16.438814 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpkmb\" (UniqueName: \"kubernetes.io/projected/6cfaae64-1d23-4079-85de-be74aef93262-kube-api-access-xpkmb\") pod \"model-serving-api-54d89bd5fc-6nkzw\" (UID: \"6cfaae64-1d23-4079-85de-be74aef93262\") " pod="opendatahub/model-serving-api-54d89bd5fc-6nkzw" Jul 08 19:43:16.539785 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:16.539750 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfaae64-1d23-4079-85de-be74aef93262-tls-certs\") pod \"model-serving-api-54d89bd5fc-6nkzw\" (UID: \"6cfaae64-1d23-4079-85de-be74aef93262\") " pod="opendatahub/model-serving-api-54d89bd5fc-6nkzw" Jul 08 19:43:16.539966 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:16.539808 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpkmb\" (UniqueName: \"kubernetes.io/projected/6cfaae64-1d23-4079-85de-be74aef93262-kube-api-access-xpkmb\") pod \"model-serving-api-54d89bd5fc-6nkzw\" (UID: \"6cfaae64-1d23-4079-85de-be74aef93262\") " pod="opendatahub/model-serving-api-54d89bd5fc-6nkzw" Jul 08 19:43:16.540238 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:43:16.540141 2553 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 08 19:43:16.540238 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:43:16.540215 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cfaae64-1d23-4079-85de-be74aef93262-tls-certs podName:6cfaae64-1d23-4079-85de-be74aef93262 nodeName:}" failed. No retries permitted until 2026-07-08 19:43:17.040195971 +0000 UTC m=+518.793840198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6cfaae64-1d23-4079-85de-be74aef93262-tls-certs") pod "model-serving-api-54d89bd5fc-6nkzw" (UID: "6cfaae64-1d23-4079-85de-be74aef93262") : secret "model-serving-api-tls" not found Jul 08 19:43:16.551338 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:16.551314 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpkmb\" (UniqueName: \"kubernetes.io/projected/6cfaae64-1d23-4079-85de-be74aef93262-kube-api-access-xpkmb\") pod \"model-serving-api-54d89bd5fc-6nkzw\" (UID: \"6cfaae64-1d23-4079-85de-be74aef93262\") " pod="opendatahub/model-serving-api-54d89bd5fc-6nkzw" Jul 08 19:43:17.045138 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:17.045103 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfaae64-1d23-4079-85de-be74aef93262-tls-certs\") pod \"model-serving-api-54d89bd5fc-6nkzw\" (UID: \"6cfaae64-1d23-4079-85de-be74aef93262\") " pod="opendatahub/model-serving-api-54d89bd5fc-6nkzw" Jul 08 19:43:17.047879 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:17.047855 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cfaae64-1d23-4079-85de-be74aef93262-tls-certs\") pod \"model-serving-api-54d89bd5fc-6nkzw\" (UID: \"6cfaae64-1d23-4079-85de-be74aef93262\") " pod="opendatahub/model-serving-api-54d89bd5fc-6nkzw" Jul 08 19:43:17.284926 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:17.284895 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6nkzw" Jul 08 19:43:17.440809 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:17.440743 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6nkzw"] Jul 08 19:43:17.444183 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:43:17.443938 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cfaae64_1d23_4079_85de_be74aef93262.slice/crio-4d1bb17ab593056b8ffa958c0171e99de2bb19026bbd3f9b5c8868d4f4cb4faf WatchSource:0}: Error finding container 4d1bb17ab593056b8ffa958c0171e99de2bb19026bbd3f9b5c8868d4f4cb4faf: Status 404 returned error can't find the container with id 4d1bb17ab593056b8ffa958c0171e99de2bb19026bbd3f9b5c8868d4f4cb4faf Jul 08 19:43:17.736024 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:17.735948 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6nkzw" event={"ID":"6cfaae64-1d23-4079-85de-be74aef93262","Type":"ContainerStarted","Data":"4d1bb17ab593056b8ffa958c0171e99de2bb19026bbd3f9b5c8868d4f4cb4faf"} Jul 08 19:43:18.742426 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:18.742343 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-769fbf6cd9-q6nks" event={"ID":"1e45aa04-75ad-4665-8a03-0eaca2f5f7e5","Type":"ContainerStarted","Data":"abd93c5ef4629cb7cc68b5aa8ab0d8c5a658957428388f58ac686a18f28f370e"} Jul 08 19:43:18.761389 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:18.761319 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-769fbf6cd9-q6nks" podStartSLOduration=1.012613752 podStartE2EDuration="3.761303262s" totalImagesPullingTime="2.74868951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:43:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:43:18.760129917 +0000 UTC m=+520.513774161" watchObservedRunningTime="2026-07-08 19:43:18.761303262 +0000 UTC m=+520.514947505" Jul 08 19:43:20.548354 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.548320 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4"] Jul 08 19:43:20.550934 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.550909 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.554224 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.554204 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 19:43:20.554472 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.554455 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gbh7h\"" Jul 08 19:43:20.568597 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.568565 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4"] Jul 08 19:43:20.677793 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.677768 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh6t9\" (UniqueName: \"kubernetes.io/projected/872ecbae-50b7-4833-9657-5822eef90a4a-kube-api-access-lh6t9\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.677934 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.677810 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/872ecbae-50b7-4833-9657-5822eef90a4a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.677934 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.677833 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/872ecbae-50b7-4833-9657-5822eef90a4a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.677934 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.677859 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/872ecbae-50b7-4833-9657-5822eef90a4a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.677934 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.677881 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/872ecbae-50b7-4833-9657-5822eef90a4a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.677934 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.677931 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/872ecbae-50b7-4833-9657-5822eef90a4a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.678116 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.677964 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/872ecbae-50b7-4833-9657-5822eef90a4a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.678116 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.677979 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/872ecbae-50b7-4833-9657-5822eef90a4a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.678116 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.678036 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/872ecbae-50b7-4833-9657-5822eef90a4a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.754156 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.754126 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6nkzw" event={"ID":"6cfaae64-1d23-4079-85de-be74aef93262","Type":"ContainerStarted","Data":"5b3648618134b7b5c026df2766a7bb6aacff85c2c13d76788ece667b428d2562"} Jul 08 19:43:20.754323 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.754237 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-6nkzw" Jul 08 19:43:20.773526 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.773485 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-6nkzw" podStartSLOduration=2.367331874 podStartE2EDuration="4.773470955s" totalImagesPullingTime="2.406139081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:43:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:43:20.771739476 +0000 UTC m=+522.525383717" watchObservedRunningTime="2026-07-08 19:43:20.773470955 +0000 UTC m=+522.527115197" Jul 08 19:43:20.778366 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.778343 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/872ecbae-50b7-4833-9657-5822eef90a4a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.778480 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.778381 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh6t9\" (UniqueName: \"kubernetes.io/projected/872ecbae-50b7-4833-9657-5822eef90a4a-kube-api-access-lh6t9\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.778480 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.778413 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/872ecbae-50b7-4833-9657-5822eef90a4a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.778480 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.778451 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/872ecbae-50b7-4833-9657-5822eef90a4a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.778480 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.778476 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/872ecbae-50b7-4833-9657-5822eef90a4a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.778679 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.778498 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/872ecbae-50b7-4833-9657-5822eef90a4a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.778679 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.778533 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/872ecbae-50b7-4833-9657-5822eef90a4a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.778679 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.778584 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/872ecbae-50b7-4833-9657-5822eef90a4a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.778679 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.778607 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/872ecbae-50b7-4833-9657-5822eef90a4a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.778877 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.778807 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/872ecbae-50b7-4833-9657-5822eef90a4a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.778939 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.778915 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/872ecbae-50b7-4833-9657-5822eef90a4a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.778987 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.778963 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/872ecbae-50b7-4833-9657-5822eef90a4a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.779023 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.779001 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/872ecbae-50b7-4833-9657-5822eef90a4a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.779268 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.779251 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/872ecbae-50b7-4833-9657-5822eef90a4a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.781161 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.781135 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/872ecbae-50b7-4833-9657-5822eef90a4a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.781372 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.781352 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/872ecbae-50b7-4833-9657-5822eef90a4a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.791576 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.791546 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh6t9\" (UniqueName: \"kubernetes.io/projected/872ecbae-50b7-4833-9657-5822eef90a4a-kube-api-access-lh6t9\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.791829 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.791809 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/872ecbae-50b7-4833-9657-5822eef90a4a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q5xj4\" (UID: \"872ecbae-50b7-4833-9657-5822eef90a4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.864651 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.864599 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:20.999199 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:20.999175 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4"] Jul 08 19:43:21.001668 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:43:21.001639 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872ecbae_50b7_4833_9657_5822eef90a4a.slice/crio-33b2114f2e03e2f276c46f691f104344ccc7f2d5d8d14e87c43274546d0f4e6d WatchSource:0}: Error finding container 33b2114f2e03e2f276c46f691f104344ccc7f2d5d8d14e87c43274546d0f4e6d: Status 404 returned error can't find the container with id 33b2114f2e03e2f276c46f691f104344ccc7f2d5d8d14e87c43274546d0f4e6d Jul 08 19:43:21.759784 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:21.759749 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" event={"ID":"872ecbae-50b7-4833-9657-5822eef90a4a","Type":"ContainerStarted","Data":"33b2114f2e03e2f276c46f691f104344ccc7f2d5d8d14e87c43274546d0f4e6d"} Jul 08 19:43:24.920181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:24.920145 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4"] Jul 08 19:43:24.927529 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:24.927500 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:24.930902 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:24.930876 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 08 19:43:24.931075 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:24.931051 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 08 19:43:24.931517 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:24.931496 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 08 19:43:24.931632 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:24.931505 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5v2km\"" Jul 08 19:43:24.938290 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:24.938266 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4"] Jul 08 19:43:25.026135 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.026096 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.026315 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.026143 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.026315 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.026182 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.026414 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.026312 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.026414 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.026339 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b255m\" (UniqueName: \"kubernetes.io/projected/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-kube-api-access-b255m\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.026414 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.026394 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.026564 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.026419 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.097692 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.097649 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 08 19:43:25.097797 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.097744 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 08 19:43:25.097797 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.097788 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 08 19:43:25.127266 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.127243 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.127363 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.127271 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b255m\" (UniqueName: \"kubernetes.io/projected/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-kube-api-access-b255m\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.127363 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.127304 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.127493 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.127445 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.127554 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.127536 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.127594 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.127569 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.127638 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.127604 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.128361 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.128335 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.129690 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.129668 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.129780 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.129754 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.130068 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.130048 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.130127 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.130095 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.163826 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.163800 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.168476 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.168453 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b255m\" (UniqueName: \"kubernetes.io/projected/63c7ed82-95ee-4fd3-bc19-eae5aaa814f0-kube-api-access-b255m\") pod \"istiod-openshift-gateway-94bb8fbfd-2f8g4\" (UID: \"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.239051 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.239019 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:25.420217 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.420194 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4"] Jul 08 19:43:25.421452 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:43:25.421411 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c7ed82_95ee_4fd3_bc19_eae5aaa814f0.slice/crio-d13cbb57d4c514d6e84ea7c6dddab9100957be9916aaae1fe9545912d32da351 WatchSource:0}: Error finding container d13cbb57d4c514d6e84ea7c6dddab9100957be9916aaae1fe9545912d32da351: Status 404 returned error can't find the container with id d13cbb57d4c514d6e84ea7c6dddab9100957be9916aaae1fe9545912d32da351 Jul 08 19:43:25.784803 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.784764 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" event={"ID":"872ecbae-50b7-4833-9657-5822eef90a4a","Type":"ContainerStarted","Data":"190799cebd4df21d67637d5a810591317624991ce3826839c9cbec51ae75a730"} Jul 08 19:43:25.786339 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.786307 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" event={"ID":"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0","Type":"ContainerStarted","Data":"d13cbb57d4c514d6e84ea7c6dddab9100957be9916aaae1fe9545912d32da351"} Jul 08 19:43:25.850580 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.850528 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" podStartSLOduration=1.757036014 podStartE2EDuration="5.85051491s" totalImagesPullingTime="4.093478896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:43:25.849576563 +0000 UTC m=+527.603220835" watchObservedRunningTime="2026-07-08 19:43:25.85051491 +0000 UTC m=+527.604159150" Jul 08 19:43:25.865165 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:25.865131 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:26.735482 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:26.735239 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6h794"] Jul 08 19:43:26.738226 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:26.738206 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6h794" Jul 08 19:43:26.746428 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:26.746393 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-lcpnc\"" Jul 08 19:43:26.747161 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:26.747086 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 08 19:43:26.769620 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:26.769551 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6h794"] Jul 08 19:43:26.782182 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:26.782156 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6pc72"] Jul 08 19:43:26.785257 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:26.785213 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pc72" Jul 08 19:43:26.791070 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:26.790876 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-drxn2\"" Jul 08 19:43:26.792683 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:26.791090 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 08 19:43:26.796737 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:26.796714 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6pc72"] Jul 08 19:43:26.848081 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:26.847997 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d6dfda9-137f-4c35-84a0-9fb7b9edce9c-cert\") pod \"kserve-controller-manager-d6f4b65b8-6h794\" (UID: \"3d6dfda9-137f-4c35-84a0-9fb7b9edce9c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6h794" Jul 08 19:43:26.848250 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:26.848121 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66g6k\" (UniqueName: \"kubernetes.io/projected/3d6dfda9-137f-4c35-84a0-9fb7b9edce9c-kube-api-access-66g6k\") pod \"kserve-controller-manager-d6f4b65b8-6h794\" (UID: \"3d6dfda9-137f-4c35-84a0-9fb7b9edce9c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6h794" Jul 08 19:43:26.869641 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:26.869613 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:26.949640 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:26.949608 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d6dfda9-137f-4c35-84a0-9fb7b9edce9c-cert\") pod \"kserve-controller-manager-d6f4b65b8-6h794\" (UID: \"3d6dfda9-137f-4c35-84a0-9fb7b9edce9c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6h794" Jul 08 19:43:26.949823 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:43:26.949722 2553 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 08 19:43:26.949823 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:26.949753 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66g6k\" (UniqueName: \"kubernetes.io/projected/3d6dfda9-137f-4c35-84a0-9fb7b9edce9c-kube-api-access-66g6k\") pod \"kserve-controller-manager-d6f4b65b8-6h794\" (UID: \"3d6dfda9-137f-4c35-84a0-9fb7b9edce9c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6h794" Jul 08 19:43:26.949823 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:43:26.949790 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6dfda9-137f-4c35-84a0-9fb7b9edce9c-cert podName:3d6dfda9-137f-4c35-84a0-9fb7b9edce9c nodeName:}" failed. No retries permitted until 2026-07-08 19:43:27.449768911 +0000 UTC m=+529.203413135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3d6dfda9-137f-4c35-84a0-9fb7b9edce9c-cert") pod "kserve-controller-manager-d6f4b65b8-6h794" (UID: "3d6dfda9-137f-4c35-84a0-9fb7b9edce9c") : secret "kserve-webhook-server-cert" not found Jul 08 19:43:26.950020 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:26.949984 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd74b967-2861-413c-8acc-326c4f6a69bc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6pc72\" (UID: \"fd74b967-2861-413c-8acc-326c4f6a69bc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pc72" Jul 08 19:43:26.950072 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:26.950032 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c9v4\" (UniqueName: \"kubernetes.io/projected/fd74b967-2861-413c-8acc-326c4f6a69bc-kube-api-access-7c9v4\") pod \"llmisvc-controller-manager-777c6bd7d5-6pc72\" (UID: \"fd74b967-2861-413c-8acc-326c4f6a69bc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pc72" Jul 08 19:43:26.958850 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:26.958818 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66g6k\" (UniqueName: \"kubernetes.io/projected/3d6dfda9-137f-4c35-84a0-9fb7b9edce9c-kube-api-access-66g6k\") pod \"kserve-controller-manager-d6f4b65b8-6h794\" (UID: \"3d6dfda9-137f-4c35-84a0-9fb7b9edce9c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6h794" Jul 08 19:43:27.051034 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:27.050996 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd74b967-2861-413c-8acc-326c4f6a69bc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6pc72\" (UID: \"fd74b967-2861-413c-8acc-326c4f6a69bc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pc72" Jul 08 19:43:27.051034 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:27.051039 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c9v4\" (UniqueName: \"kubernetes.io/projected/fd74b967-2861-413c-8acc-326c4f6a69bc-kube-api-access-7c9v4\") pod \"llmisvc-controller-manager-777c6bd7d5-6pc72\" (UID: \"fd74b967-2861-413c-8acc-326c4f6a69bc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pc72" Jul 08 19:43:27.051292 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:43:27.051175 2553 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 08 19:43:27.051292 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:43:27.051255 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd74b967-2861-413c-8acc-326c4f6a69bc-cert podName:fd74b967-2861-413c-8acc-326c4f6a69bc nodeName:}" failed. No retries permitted until 2026-07-08 19:43:27.551233198 +0000 UTC m=+529.304877420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd74b967-2861-413c-8acc-326c4f6a69bc-cert") pod "llmisvc-controller-manager-777c6bd7d5-6pc72" (UID: "fd74b967-2861-413c-8acc-326c4f6a69bc") : secret "llmisvc-webhook-server-cert" not found Jul 08 19:43:27.061877 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:27.061813 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c9v4\" (UniqueName: \"kubernetes.io/projected/fd74b967-2861-413c-8acc-326c4f6a69bc-kube-api-access-7c9v4\") pod \"llmisvc-controller-manager-777c6bd7d5-6pc72\" (UID: \"fd74b967-2861-413c-8acc-326c4f6a69bc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pc72" Jul 08 19:43:27.455728 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:27.455634 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d6dfda9-137f-4c35-84a0-9fb7b9edce9c-cert\") pod \"kserve-controller-manager-d6f4b65b8-6h794\" (UID: \"3d6dfda9-137f-4c35-84a0-9fb7b9edce9c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6h794" Jul 08 19:43:27.458430 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:27.458406 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d6dfda9-137f-4c35-84a0-9fb7b9edce9c-cert\") pod \"kserve-controller-manager-d6f4b65b8-6h794\" (UID: \"3d6dfda9-137f-4c35-84a0-9fb7b9edce9c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6h794" Jul 08 19:43:27.556777 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:27.556747 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd74b967-2861-413c-8acc-326c4f6a69bc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6pc72\" (UID: \"fd74b967-2861-413c-8acc-326c4f6a69bc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pc72" Jul 08 19:43:27.559243 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:27.559217 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd74b967-2861-413c-8acc-326c4f6a69bc-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6pc72\" (UID: \"fd74b967-2861-413c-8acc-326c4f6a69bc\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pc72" Jul 08 19:43:27.653395 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:27.653355 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6h794" Jul 08 19:43:27.703151 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:27.703121 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pc72" Jul 08 19:43:27.804135 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:27.804091 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:27.805119 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:27.805094 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q5xj4" Jul 08 19:43:28.176906 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:28.176872 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 08 19:43:28.176987 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:28.176941 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 08 19:43:28.307525 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:28.307494 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6h794"] Jul 08 19:43:28.309925 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:43:28.309895 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6dfda9_137f_4c35_84a0_9fb7b9edce9c.slice/crio-a4ea314e850b6208936993d9fe7eb0154e3085af9d2275be95ddd0317e4c6cc6 WatchSource:0}: Error finding container a4ea314e850b6208936993d9fe7eb0154e3085af9d2275be95ddd0317e4c6cc6: Status 404 returned error can't find the container with id a4ea314e850b6208936993d9fe7eb0154e3085af9d2275be95ddd0317e4c6cc6 Jul 08 19:43:28.513224 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:28.513201 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6pc72"] Jul 08 19:43:28.515232 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:43:28.515209 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfd74b967_2861_413c_8acc_326c4f6a69bc.slice/crio-e69335e9f1f59e79530de59b4eeb1e79a229b199b63f7dcb4a6d268d2f20b126 WatchSource:0}: Error finding container e69335e9f1f59e79530de59b4eeb1e79a229b199b63f7dcb4a6d268d2f20b126: Status 404 returned error can't find the container with id e69335e9f1f59e79530de59b4eeb1e79a229b199b63f7dcb4a6d268d2f20b126 Jul 08 19:43:28.810530 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:28.810491 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" event={"ID":"63c7ed82-95ee-4fd3-bc19-eae5aaa814f0","Type":"ContainerStarted","Data":"84dbf0414952d81489cf2968f4e32f565f797c712b7c4b96581b4f03eb346d2c"} Jul 08 19:43:28.811013 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:28.810561 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:28.811977 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:28.811947 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pc72" event={"ID":"fd74b967-2861-413c-8acc-326c4f6a69bc","Type":"ContainerStarted","Data":"e69335e9f1f59e79530de59b4eeb1e79a229b199b63f7dcb4a6d268d2f20b126"} Jul 08 19:43:28.813242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:28.813200 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6h794" event={"ID":"3d6dfda9-137f-4c35-84a0-9fb7b9edce9c","Type":"ContainerStarted","Data":"a4ea314e850b6208936993d9fe7eb0154e3085af9d2275be95ddd0317e4c6cc6"} Jul 08 19:43:28.835737 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:28.835694 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" podStartSLOduration=2.082629634 podStartE2EDuration="4.835679393s" totalImagesPullingTime="2.753049759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:43:28.834592584 +0000 UTC m=+530.588236864" watchObservedRunningTime="2026-07-08 19:43:28.835679393 +0000 UTC m=+530.589323634" Jul 08 19:43:29.821370 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:29.821342 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2f8g4" Jul 08 19:43:31.764785 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:31.764756 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-6nkzw" Jul 08 19:43:31.836100 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:31.836060 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6h794" event={"ID":"3d6dfda9-137f-4c35-84a0-9fb7b9edce9c","Type":"ContainerStarted","Data":"4a5e69c22503dd133a83a8d7120cf90924e6a91b04c00c2167a5bbea99dee386"} Jul 08 19:43:31.836283 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:31.836246 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6h794" Jul 08 19:43:31.855197 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:31.855138 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6h794" podStartSLOduration=2.904529862 podStartE2EDuration="5.855119004s" totalImagesPullingTime="2.950589142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:43:31.852317228 +0000 UTC m=+533.605961482" watchObservedRunningTime="2026-07-08 19:43:31.855119004 +0000 UTC m=+533.608763246" Jul 08 19:43:32.842817 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:32.842775 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pc72" event={"ID":"fd74b967-2861-413c-8acc-326c4f6a69bc","Type":"ContainerStarted","Data":"199a4ab884094aed2c2612af57597e7ccdd7b63c713710636a422f2d7f7c17de"} Jul 08 19:43:32.843286 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:32.842840 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pc72" Jul 08 19:43:32.863454 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:43:32.863393 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pc72" podStartSLOduration=3.127301145 podStartE2EDuration="6.863379046s" totalImagesPullingTime="3.736077901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:43:32.862201315 +0000 UTC m=+534.615845556" watchObservedRunningTime="2026-07-08 19:43:32.863379046 +0000 UTC m=+534.617023308" Jul 08 19:44:02.848562 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:02.848530 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6h794" Jul 08 19:44:03.850569 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:03.850539 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6pc72" Jul 08 19:44:31.969318 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:31.969275 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm"] Jul 08 19:44:31.974922 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:31.974898 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm" Jul 08 19:44:31.977597 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:31.977572 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 19:44:31.977717 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:31.977623 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 19:44:31.978743 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:31.978636 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kxwp2\"" Jul 08 19:44:31.981877 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:31.981858 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm"] Jul 08 19:44:32.107147 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:32.107114 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a3fd6f4-c46f-46f9-831a-e95274a6d18f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm\" (UID: \"8a3fd6f4-c46f-46f9-831a-e95274a6d18f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm" Jul 08 19:44:32.107147 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:32.107158 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a3fd6f4-c46f-46f9-831a-e95274a6d18f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm\" (UID: \"8a3fd6f4-c46f-46f9-831a-e95274a6d18f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm" Jul 08 19:44:32.107340 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:32.107234 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gclth\" (UniqueName: \"kubernetes.io/projected/8a3fd6f4-c46f-46f9-831a-e95274a6d18f-kube-api-access-gclth\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm\" (UID: \"8a3fd6f4-c46f-46f9-831a-e95274a6d18f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm" Jul 08 19:44:32.207791 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:32.207748 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gclth\" (UniqueName: \"kubernetes.io/projected/8a3fd6f4-c46f-46f9-831a-e95274a6d18f-kube-api-access-gclth\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm\" (UID: \"8a3fd6f4-c46f-46f9-831a-e95274a6d18f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm" Jul 08 19:44:32.207954 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:32.207816 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a3fd6f4-c46f-46f9-831a-e95274a6d18f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm\" (UID: \"8a3fd6f4-c46f-46f9-831a-e95274a6d18f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm" Jul 08 19:44:32.207954 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:32.207844 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a3fd6f4-c46f-46f9-831a-e95274a6d18f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm\" (UID: \"8a3fd6f4-c46f-46f9-831a-e95274a6d18f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm" Jul 08 19:44:32.208174 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:32.208156 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a3fd6f4-c46f-46f9-831a-e95274a6d18f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm\" (UID: \"8a3fd6f4-c46f-46f9-831a-e95274a6d18f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm" Jul 08 19:44:32.208210 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:32.208164 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a3fd6f4-c46f-46f9-831a-e95274a6d18f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm\" (UID: \"8a3fd6f4-c46f-46f9-831a-e95274a6d18f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm" Jul 08 19:44:32.217520 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:32.217493 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gclth\" (UniqueName: \"kubernetes.io/projected/8a3fd6f4-c46f-46f9-831a-e95274a6d18f-kube-api-access-gclth\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm\" (UID: \"8a3fd6f4-c46f-46f9-831a-e95274a6d18f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm" Jul 08 19:44:32.285448 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:32.285420 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm" Jul 08 19:44:32.420133 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:32.420079 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm"] Jul 08 19:44:32.420851 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:44:32.420826 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3fd6f4_c46f_46f9_831a_e95274a6d18f.slice/crio-b19a71333fbcc21ccd81b667292509682131e70b5fa07ce83b93d2dc0fb2e776 WatchSource:0}: Error finding container b19a71333fbcc21ccd81b667292509682131e70b5fa07ce83b93d2dc0fb2e776: Status 404 returned error can't find the container with id b19a71333fbcc21ccd81b667292509682131e70b5fa07ce83b93d2dc0fb2e776 Jul 08 19:44:32.778956 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:32.778928 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm"] Jul 08 19:44:32.782562 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:32.782546 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm" Jul 08 19:44:32.786998 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:32.786978 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm"] Jul 08 19:44:32.914409 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:32.914374 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b35c1f00-0866-44ca-8314-1497603a30fa-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm\" (UID: \"b35c1f00-0866-44ca-8314-1497603a30fa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm" Jul 08 19:44:32.914598 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:32.914414 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b35c1f00-0866-44ca-8314-1497603a30fa-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm\" (UID: \"b35c1f00-0866-44ca-8314-1497603a30fa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm" Jul 08 19:44:32.914598 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:32.914505 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpqlf\" (UniqueName: \"kubernetes.io/projected/b35c1f00-0866-44ca-8314-1497603a30fa-kube-api-access-qpqlf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm\" (UID: \"b35c1f00-0866-44ca-8314-1497603a30fa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm" Jul 08 19:44:33.015946 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.015913 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b35c1f00-0866-44ca-8314-1497603a30fa-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm\" (UID: \"b35c1f00-0866-44ca-8314-1497603a30fa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm" Jul 08 19:44:33.016373 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.015952 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b35c1f00-0866-44ca-8314-1497603a30fa-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm\" (UID: \"b35c1f00-0866-44ca-8314-1497603a30fa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm" Jul 08 19:44:33.016373 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.015980 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpqlf\" (UniqueName: \"kubernetes.io/projected/b35c1f00-0866-44ca-8314-1497603a30fa-kube-api-access-qpqlf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm\" (UID: \"b35c1f00-0866-44ca-8314-1497603a30fa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm" Jul 08 19:44:33.016373 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.016317 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b35c1f00-0866-44ca-8314-1497603a30fa-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm\" (UID: \"b35c1f00-0866-44ca-8314-1497603a30fa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm" Jul 08 19:44:33.016373 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.016342 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b35c1f00-0866-44ca-8314-1497603a30fa-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm\" (UID: \"b35c1f00-0866-44ca-8314-1497603a30fa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm" Jul 08 19:44:33.025110 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.025077 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpqlf\" (UniqueName: \"kubernetes.io/projected/b35c1f00-0866-44ca-8314-1497603a30fa-kube-api-access-qpqlf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm\" (UID: \"b35c1f00-0866-44ca-8314-1497603a30fa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm" Jul 08 19:44:33.093465 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.093385 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm" Jul 08 19:44:33.146259 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.146160 2553 generic.go:356] "Generic (PLEG): container finished" podID="8a3fd6f4-c46f-46f9-831a-e95274a6d18f" containerID="69bcc6398e7a7c85e1ecb543ed1011dd6c75fa38a81ad49c7bd1eebc63fe419e" exitCode=0 Jul 08 19:44:33.146377 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.146254 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm" event={"ID":"8a3fd6f4-c46f-46f9-831a-e95274a6d18f","Type":"ContainerDied","Data":"69bcc6398e7a7c85e1ecb543ed1011dd6c75fa38a81ad49c7bd1eebc63fe419e"} Jul 08 19:44:33.146377 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.146322 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm" event={"ID":"8a3fd6f4-c46f-46f9-831a-e95274a6d18f","Type":"ContainerStarted","Data":"b19a71333fbcc21ccd81b667292509682131e70b5fa07ce83b93d2dc0fb2e776"} Jul 08 19:44:33.225532 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.225494 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm"] Jul 08 19:44:33.228647 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:44:33.228617 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb35c1f00_0866_44ca_8314_1497603a30fa.slice/crio-740b36258fbba5d8cde6e64ef4145ada0d66845464603d07b0227c06a211ee4f WatchSource:0}: Error finding container 740b36258fbba5d8cde6e64ef4145ada0d66845464603d07b0227c06a211ee4f: Status 404 returned error can't find the container with id 740b36258fbba5d8cde6e64ef4145ada0d66845464603d07b0227c06a211ee4f Jul 08 19:44:33.366973 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.366916 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf"] Jul 08 19:44:33.370458 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.370428 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" Jul 08 19:44:33.379490 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.379468 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf"] Jul 08 19:44:33.520745 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.520715 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2af2ec91-cc70-4720-8753-0c8a1a842516-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf\" (UID: \"2af2ec91-cc70-4720-8753-0c8a1a842516\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" Jul 08 19:44:33.520745 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.520746 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m64zf\" (UniqueName: \"kubernetes.io/projected/2af2ec91-cc70-4720-8753-0c8a1a842516-kube-api-access-m64zf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf\" (UID: \"2af2ec91-cc70-4720-8753-0c8a1a842516\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" Jul 08 19:44:33.520921 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.520789 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2af2ec91-cc70-4720-8753-0c8a1a842516-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf\" (UID: \"2af2ec91-cc70-4720-8753-0c8a1a842516\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" Jul 08 19:44:33.622311 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.622245 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2af2ec91-cc70-4720-8753-0c8a1a842516-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf\" (UID: \"2af2ec91-cc70-4720-8753-0c8a1a842516\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" Jul 08 19:44:33.622311 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.622279 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m64zf\" (UniqueName: \"kubernetes.io/projected/2af2ec91-cc70-4720-8753-0c8a1a842516-kube-api-access-m64zf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf\" (UID: \"2af2ec91-cc70-4720-8753-0c8a1a842516\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" Jul 08 19:44:33.622466 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.622337 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2af2ec91-cc70-4720-8753-0c8a1a842516-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf\" (UID: \"2af2ec91-cc70-4720-8753-0c8a1a842516\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" Jul 08 19:44:33.622726 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.622707 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2af2ec91-cc70-4720-8753-0c8a1a842516-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf\" (UID: \"2af2ec91-cc70-4720-8753-0c8a1a842516\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" Jul 08 19:44:33.622764 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.622718 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2af2ec91-cc70-4720-8753-0c8a1a842516-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf\" (UID: \"2af2ec91-cc70-4720-8753-0c8a1a842516\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" Jul 08 19:44:33.631908 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.631879 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m64zf\" (UniqueName: \"kubernetes.io/projected/2af2ec91-cc70-4720-8753-0c8a1a842516-kube-api-access-m64zf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf\" (UID: \"2af2ec91-cc70-4720-8753-0c8a1a842516\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" Jul 08 19:44:33.693868 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.693841 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" Jul 08 19:44:33.770932 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.770903 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5"] Jul 08 19:44:33.775216 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.775192 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5" Jul 08 19:44:33.785766 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.785740 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5"] Jul 08 19:44:33.833183 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.833159 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf"] Jul 08 19:44:33.835154 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:44:33.835125 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af2ec91_cc70_4720_8753_0c8a1a842516.slice/crio-c15f85e52ae06baa5c136e295b300de635bd066f744d5338d2189cefa08b85d7 WatchSource:0}: Error finding container c15f85e52ae06baa5c136e295b300de635bd066f744d5338d2189cefa08b85d7: Status 404 returned error can't find the container with id c15f85e52ae06baa5c136e295b300de635bd066f744d5338d2189cefa08b85d7 Jul 08 19:44:33.925367 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.925342 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/285fbfe1-151b-4fe1-a2b3-69f66b2ecfba-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5\" (UID: \"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5" Jul 08 19:44:33.925505 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.925487 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r69rv\" (UniqueName: \"kubernetes.io/projected/285fbfe1-151b-4fe1-a2b3-69f66b2ecfba-kube-api-access-r69rv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5\" (UID: \"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5" Jul 08 19:44:33.925839 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:33.925801 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/285fbfe1-151b-4fe1-a2b3-69f66b2ecfba-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5\" (UID: \"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5" Jul 08 19:44:34.026642 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:34.026615 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/285fbfe1-151b-4fe1-a2b3-69f66b2ecfba-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5\" (UID: \"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5" Jul 08 19:44:34.026935 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:34.026664 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/285fbfe1-151b-4fe1-a2b3-69f66b2ecfba-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5\" (UID: \"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5" Jul 08 19:44:34.026935 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:34.026703 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r69rv\" (UniqueName: \"kubernetes.io/projected/285fbfe1-151b-4fe1-a2b3-69f66b2ecfba-kube-api-access-r69rv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5\" (UID: \"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5" Jul 08 19:44:34.026935 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:34.026925 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/285fbfe1-151b-4fe1-a2b3-69f66b2ecfba-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5\" (UID: \"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5" Jul 08 19:44:34.027035 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:34.026965 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/285fbfe1-151b-4fe1-a2b3-69f66b2ecfba-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5\" (UID: \"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5" Jul 08 19:44:34.035297 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:34.035275 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r69rv\" (UniqueName: \"kubernetes.io/projected/285fbfe1-151b-4fe1-a2b3-69f66b2ecfba-kube-api-access-r69rv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5\" (UID: \"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5" Jul 08 19:44:34.088356 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:34.088329 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5" Jul 08 19:44:34.155984 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:34.155953 2553 generic.go:356] "Generic (PLEG): container finished" podID="b35c1f00-0866-44ca-8314-1497603a30fa" containerID="4ed0e33264d97f76304c52de736a791646f82d3bc2d3d437a8f377f0139f6e19" exitCode=0 Jul 08 19:44:34.156134 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:34.155990 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm" event={"ID":"b35c1f00-0866-44ca-8314-1497603a30fa","Type":"ContainerDied","Data":"4ed0e33264d97f76304c52de736a791646f82d3bc2d3d437a8f377f0139f6e19"} Jul 08 19:44:34.156134 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:34.156042 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm" event={"ID":"b35c1f00-0866-44ca-8314-1497603a30fa","Type":"ContainerStarted","Data":"740b36258fbba5d8cde6e64ef4145ada0d66845464603d07b0227c06a211ee4f"} Jul 08 19:44:34.157860 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:34.157815 2553 generic.go:356] "Generic (PLEG): container finished" podID="2af2ec91-cc70-4720-8753-0c8a1a842516" containerID="c3c4e2486eeb703cf624e89345dc13f95d196e4114aa9ed6d14398aec2e8bc7c" exitCode=0 Jul 08 19:44:34.157983 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:34.157868 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" event={"ID":"2af2ec91-cc70-4720-8753-0c8a1a842516","Type":"ContainerDied","Data":"c3c4e2486eeb703cf624e89345dc13f95d196e4114aa9ed6d14398aec2e8bc7c"} Jul 08 19:44:34.157983 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:34.157912 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" event={"ID":"2af2ec91-cc70-4720-8753-0c8a1a842516","Type":"ContainerStarted","Data":"c15f85e52ae06baa5c136e295b300de635bd066f744d5338d2189cefa08b85d7"} Jul 08 19:44:34.160291 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:34.160248 2553 generic.go:356] "Generic (PLEG): container finished" podID="8a3fd6f4-c46f-46f9-831a-e95274a6d18f" containerID="483284e1d9b75de3d1f79c6bd4d8199b92d62b21f419065238d14dacf6badf7a" exitCode=0 Jul 08 19:44:34.160385 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:34.160336 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm" event={"ID":"8a3fd6f4-c46f-46f9-831a-e95274a6d18f","Type":"ContainerDied","Data":"483284e1d9b75de3d1f79c6bd4d8199b92d62b21f419065238d14dacf6badf7a"} Jul 08 19:44:34.236752 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:34.236725 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5"] Jul 08 19:44:34.238907 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:44:34.238879 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285fbfe1_151b_4fe1_a2b3_69f66b2ecfba.slice/crio-c5e37771d39258bf3a088f8c728d8826b465ae89df4b0f6d1b55c7a066933760 WatchSource:0}: Error finding container c5e37771d39258bf3a088f8c728d8826b465ae89df4b0f6d1b55c7a066933760: Status 404 returned error can't find the container with id c5e37771d39258bf3a088f8c728d8826b465ae89df4b0f6d1b55c7a066933760 Jul 08 19:44:35.169084 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:35.169048 2553 generic.go:356] "Generic (PLEG): container finished" podID="8a3fd6f4-c46f-46f9-831a-e95274a6d18f" containerID="c95224f3d8e9ba5879c75f2733a903403b38ef1a507dbcf36d3da9e2d88ec154" exitCode=0 Jul 08 19:44:35.169483 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:35.169137 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm" event={"ID":"8a3fd6f4-c46f-46f9-831a-e95274a6d18f","Type":"ContainerDied","Data":"c95224f3d8e9ba5879c75f2733a903403b38ef1a507dbcf36d3da9e2d88ec154"} Jul 08 19:44:35.170857 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:35.170832 2553 generic.go:356] "Generic (PLEG): container finished" podID="285fbfe1-151b-4fe1-a2b3-69f66b2ecfba" containerID="418ca8c5d0d92e1973138dc00b650a066860e7b7aed110615f218fd0d14b3001" exitCode=0 Jul 08 19:44:35.170977 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:35.170903 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5" event={"ID":"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba","Type":"ContainerDied","Data":"418ca8c5d0d92e1973138dc00b650a066860e7b7aed110615f218fd0d14b3001"} Jul 08 19:44:35.170977 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:35.170953 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5" event={"ID":"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba","Type":"ContainerStarted","Data":"c5e37771d39258bf3a088f8c728d8826b465ae89df4b0f6d1b55c7a066933760"} Jul 08 19:44:35.172996 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:35.172971 2553 generic.go:356] "Generic (PLEG): container finished" podID="b35c1f00-0866-44ca-8314-1497603a30fa" containerID="1ea9c09db6b1ed099cd79f7b103922eeeb24bcda7dce1412708d0859d67d0730" exitCode=0 Jul 08 19:44:35.173099 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:35.173082 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm" event={"ID":"b35c1f00-0866-44ca-8314-1497603a30fa","Type":"ContainerDied","Data":"1ea9c09db6b1ed099cd79f7b103922eeeb24bcda7dce1412708d0859d67d0730"} Jul 08 19:44:35.175412 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:35.175332 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" event={"ID":"2af2ec91-cc70-4720-8753-0c8a1a842516","Type":"ContainerStarted","Data":"056696a0d21b652c77d4b02dd2784e078496ce29f370d3a41be08e228a865142"} Jul 08 19:44:36.181674 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:36.181643 2553 generic.go:356] "Generic (PLEG): container finished" podID="285fbfe1-151b-4fe1-a2b3-69f66b2ecfba" containerID="e1e977deb5d0dd1bc82d8a724092a908d1e7f55beaa7ee6d4f8f5cd484778ef1" exitCode=0 Jul 08 19:44:36.181979 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:36.181728 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5" event={"ID":"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba","Type":"ContainerDied","Data":"e1e977deb5d0dd1bc82d8a724092a908d1e7f55beaa7ee6d4f8f5cd484778ef1"} Jul 08 19:44:36.183872 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:36.183852 2553 generic.go:356] "Generic (PLEG): container finished" podID="b35c1f00-0866-44ca-8314-1497603a30fa" containerID="b21bea377406c4e41a9f5812daf3a1e3ff05c20dbeaf296c357b30e5e3a73302" exitCode=0 Jul 08 19:44:36.183971 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:36.183941 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm" event={"ID":"b35c1f00-0866-44ca-8314-1497603a30fa","Type":"ContainerDied","Data":"b21bea377406c4e41a9f5812daf3a1e3ff05c20dbeaf296c357b30e5e3a73302"} Jul 08 19:44:36.185807 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:36.185786 2553 generic.go:356] "Generic (PLEG): container finished" podID="2af2ec91-cc70-4720-8753-0c8a1a842516" containerID="056696a0d21b652c77d4b02dd2784e078496ce29f370d3a41be08e228a865142" exitCode=0 Jul 08 19:44:36.185902 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:36.185858 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" event={"ID":"2af2ec91-cc70-4720-8753-0c8a1a842516","Type":"ContainerDied","Data":"056696a0d21b652c77d4b02dd2784e078496ce29f370d3a41be08e228a865142"} Jul 08 19:44:36.339481 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:36.339426 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm" Jul 08 19:44:36.449744 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:36.449721 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a3fd6f4-c46f-46f9-831a-e95274a6d18f-util\") pod \"8a3fd6f4-c46f-46f9-831a-e95274a6d18f\" (UID: \"8a3fd6f4-c46f-46f9-831a-e95274a6d18f\") " Jul 08 19:44:36.449845 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:36.449764 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a3fd6f4-c46f-46f9-831a-e95274a6d18f-bundle\") pod \"8a3fd6f4-c46f-46f9-831a-e95274a6d18f\" (UID: \"8a3fd6f4-c46f-46f9-831a-e95274a6d18f\") " Jul 08 19:44:36.449845 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:36.449794 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gclth\" (UniqueName: \"kubernetes.io/projected/8a3fd6f4-c46f-46f9-831a-e95274a6d18f-kube-api-access-gclth\") pod \"8a3fd6f4-c46f-46f9-831a-e95274a6d18f\" (UID: \"8a3fd6f4-c46f-46f9-831a-e95274a6d18f\") " Jul 08 19:44:36.450307 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:36.450284 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a3fd6f4-c46f-46f9-831a-e95274a6d18f-bundle" (OuterVolumeSpecName: "bundle") pod "8a3fd6f4-c46f-46f9-831a-e95274a6d18f" (UID: "8a3fd6f4-c46f-46f9-831a-e95274a6d18f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:44:36.451887 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:36.451864 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a3fd6f4-c46f-46f9-831a-e95274a6d18f-kube-api-access-gclth" (OuterVolumeSpecName: "kube-api-access-gclth") pod "8a3fd6f4-c46f-46f9-831a-e95274a6d18f" (UID: "8a3fd6f4-c46f-46f9-831a-e95274a6d18f"). InnerVolumeSpecName "kube-api-access-gclth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:44:36.455217 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:36.455197 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a3fd6f4-c46f-46f9-831a-e95274a6d18f-util" (OuterVolumeSpecName: "util") pod "8a3fd6f4-c46f-46f9-831a-e95274a6d18f" (UID: "8a3fd6f4-c46f-46f9-831a-e95274a6d18f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:44:36.551077 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:36.551055 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a3fd6f4-c46f-46f9-831a-e95274a6d18f-util\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:44:36.551077 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:36.551075 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a3fd6f4-c46f-46f9-831a-e95274a6d18f-bundle\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:44:36.551217 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:36.551085 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gclth\" (UniqueName: \"kubernetes.io/projected/8a3fd6f4-c46f-46f9-831a-e95274a6d18f-kube-api-access-gclth\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:44:37.192916 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:37.192832 2553 generic.go:356] "Generic (PLEG): container finished" podID="285fbfe1-151b-4fe1-a2b3-69f66b2ecfba" containerID="e5ab32410f5dfbcd254e860c7ceed3484725d85087557d4bd096a78ed6b4784a" exitCode=0 Jul 08 19:44:37.192916 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:37.192900 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5" event={"ID":"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba","Type":"ContainerDied","Data":"e5ab32410f5dfbcd254e860c7ceed3484725d85087557d4bd096a78ed6b4784a"} Jul 08 19:44:37.195142 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:37.195120 2553 generic.go:356] "Generic (PLEG): container finished" podID="2af2ec91-cc70-4720-8753-0c8a1a842516" containerID="50df1d9961b0052c8e00cf2ae0d3a3657ab0c2fde28397b293541270477d72ae" exitCode=0 Jul 08 19:44:37.195268 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:37.195183 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" event={"ID":"2af2ec91-cc70-4720-8753-0c8a1a842516","Type":"ContainerDied","Data":"50df1d9961b0052c8e00cf2ae0d3a3657ab0c2fde28397b293541270477d72ae"} Jul 08 19:44:37.197058 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:37.197042 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm" Jul 08 19:44:37.197152 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:37.197079 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm" event={"ID":"8a3fd6f4-c46f-46f9-831a-e95274a6d18f","Type":"ContainerDied","Data":"b19a71333fbcc21ccd81b667292509682131e70b5fa07ce83b93d2dc0fb2e776"} Jul 08 19:44:37.197152 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:37.197115 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b19a71333fbcc21ccd81b667292509682131e70b5fa07ce83b93d2dc0fb2e776" Jul 08 19:44:37.319697 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:37.319668 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm" Jul 08 19:44:37.459160 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:37.459087 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b35c1f00-0866-44ca-8314-1497603a30fa-bundle\") pod \"b35c1f00-0866-44ca-8314-1497603a30fa\" (UID: \"b35c1f00-0866-44ca-8314-1497603a30fa\") " Jul 08 19:44:37.459160 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:37.459117 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b35c1f00-0866-44ca-8314-1497603a30fa-util\") pod \"b35c1f00-0866-44ca-8314-1497603a30fa\" (UID: \"b35c1f00-0866-44ca-8314-1497603a30fa\") " Jul 08 19:44:37.459160 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:37.459136 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpqlf\" (UniqueName: \"kubernetes.io/projected/b35c1f00-0866-44ca-8314-1497603a30fa-kube-api-access-qpqlf\") pod \"b35c1f00-0866-44ca-8314-1497603a30fa\" (UID: \"b35c1f00-0866-44ca-8314-1497603a30fa\") " Jul 08 19:44:37.459579 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:37.459559 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b35c1f00-0866-44ca-8314-1497603a30fa-bundle" (OuterVolumeSpecName: "bundle") pod "b35c1f00-0866-44ca-8314-1497603a30fa" (UID: "b35c1f00-0866-44ca-8314-1497603a30fa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:44:37.461245 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:37.461221 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b35c1f00-0866-44ca-8314-1497603a30fa-kube-api-access-qpqlf" (OuterVolumeSpecName: "kube-api-access-qpqlf") pod "b35c1f00-0866-44ca-8314-1497603a30fa" (UID: "b35c1f00-0866-44ca-8314-1497603a30fa"). InnerVolumeSpecName "kube-api-access-qpqlf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:44:37.464793 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:37.464768 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b35c1f00-0866-44ca-8314-1497603a30fa-util" (OuterVolumeSpecName: "util") pod "b35c1f00-0866-44ca-8314-1497603a30fa" (UID: "b35c1f00-0866-44ca-8314-1497603a30fa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:44:37.559795 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:37.559766 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b35c1f00-0866-44ca-8314-1497603a30fa-bundle\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:44:37.559795 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:37.559789 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b35c1f00-0866-44ca-8314-1497603a30fa-util\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:44:37.559914 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:37.559802 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpqlf\" (UniqueName: \"kubernetes.io/projected/b35c1f00-0866-44ca-8314-1497603a30fa-kube-api-access-qpqlf\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:44:38.203775 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.203745 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm" Jul 08 19:44:38.203775 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.203763 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm" event={"ID":"b35c1f00-0866-44ca-8314-1497603a30fa","Type":"ContainerDied","Data":"740b36258fbba5d8cde6e64ef4145ada0d66845464603d07b0227c06a211ee4f"} Jul 08 19:44:38.204165 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.203817 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="740b36258fbba5d8cde6e64ef4145ada0d66845464603d07b0227c06a211ee4f" Jul 08 19:44:38.360218 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.359980 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" Jul 08 19:44:38.362613 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.362592 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5" Jul 08 19:44:38.466092 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.466024 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r69rv\" (UniqueName: \"kubernetes.io/projected/285fbfe1-151b-4fe1-a2b3-69f66b2ecfba-kube-api-access-r69rv\") pod \"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba\" (UID: \"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba\") " Jul 08 19:44:38.466092 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.466065 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m64zf\" (UniqueName: \"kubernetes.io/projected/2af2ec91-cc70-4720-8753-0c8a1a842516-kube-api-access-m64zf\") pod \"2af2ec91-cc70-4720-8753-0c8a1a842516\" (UID: \"2af2ec91-cc70-4720-8753-0c8a1a842516\") " Jul 08 19:44:38.466092 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.466084 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/285fbfe1-151b-4fe1-a2b3-69f66b2ecfba-util\") pod \"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba\" (UID: \"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba\") " Jul 08 19:44:38.466352 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.466115 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2af2ec91-cc70-4720-8753-0c8a1a842516-bundle\") pod \"2af2ec91-cc70-4720-8753-0c8a1a842516\" (UID: \"2af2ec91-cc70-4720-8753-0c8a1a842516\") " Jul 08 19:44:38.466352 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.466135 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2af2ec91-cc70-4720-8753-0c8a1a842516-util\") pod \"2af2ec91-cc70-4720-8753-0c8a1a842516\" (UID: \"2af2ec91-cc70-4720-8753-0c8a1a842516\") " Jul 08 19:44:38.466352 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.466224 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/285fbfe1-151b-4fe1-a2b3-69f66b2ecfba-bundle\") pod \"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba\" (UID: \"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba\") " Jul 08 19:44:38.466804 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.466766 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2af2ec91-cc70-4720-8753-0c8a1a842516-bundle" (OuterVolumeSpecName: "bundle") pod "2af2ec91-cc70-4720-8753-0c8a1a842516" (UID: "2af2ec91-cc70-4720-8753-0c8a1a842516"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:44:38.466804 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.466780 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/285fbfe1-151b-4fe1-a2b3-69f66b2ecfba-bundle" (OuterVolumeSpecName: "bundle") pod "285fbfe1-151b-4fe1-a2b3-69f66b2ecfba" (UID: "285fbfe1-151b-4fe1-a2b3-69f66b2ecfba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:44:38.468126 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.468098 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/285fbfe1-151b-4fe1-a2b3-69f66b2ecfba-kube-api-access-r69rv" (OuterVolumeSpecName: "kube-api-access-r69rv") pod "285fbfe1-151b-4fe1-a2b3-69f66b2ecfba" (UID: "285fbfe1-151b-4fe1-a2b3-69f66b2ecfba"). InnerVolumeSpecName "kube-api-access-r69rv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:44:38.468126 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.468112 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2af2ec91-cc70-4720-8753-0c8a1a842516-kube-api-access-m64zf" (OuterVolumeSpecName: "kube-api-access-m64zf") pod "2af2ec91-cc70-4720-8753-0c8a1a842516" (UID: "2af2ec91-cc70-4720-8753-0c8a1a842516"). InnerVolumeSpecName "kube-api-access-m64zf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:44:38.475092 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.475066 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/285fbfe1-151b-4fe1-a2b3-69f66b2ecfba-util" (OuterVolumeSpecName: "util") pod "285fbfe1-151b-4fe1-a2b3-69f66b2ecfba" (UID: "285fbfe1-151b-4fe1-a2b3-69f66b2ecfba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:44:38.475380 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.475360 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2af2ec91-cc70-4720-8753-0c8a1a842516-util" (OuterVolumeSpecName: "util") pod "2af2ec91-cc70-4720-8753-0c8a1a842516" (UID: "2af2ec91-cc70-4720-8753-0c8a1a842516"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:44:38.567526 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.567500 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/285fbfe1-151b-4fe1-a2b3-69f66b2ecfba-bundle\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:44:38.567526 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.567523 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r69rv\" (UniqueName: \"kubernetes.io/projected/285fbfe1-151b-4fe1-a2b3-69f66b2ecfba-kube-api-access-r69rv\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:44:38.567652 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.567534 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m64zf\" (UniqueName: \"kubernetes.io/projected/2af2ec91-cc70-4720-8753-0c8a1a842516-kube-api-access-m64zf\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:44:38.567652 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.567543 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/285fbfe1-151b-4fe1-a2b3-69f66b2ecfba-util\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:44:38.567652 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.567552 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2af2ec91-cc70-4720-8753-0c8a1a842516-bundle\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:44:38.567652 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.567559 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2af2ec91-cc70-4720-8753-0c8a1a842516-util\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:44:38.696041 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.696019 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gh46n_9d41e4e9-4418-4797-acea-bca615f11b0f/console-operator/2.log" Jul 08 19:44:38.696172 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:38.696021 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gh46n_9d41e4e9-4418-4797-acea-bca615f11b0f/console-operator/2.log" Jul 08 19:44:39.211758 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:39.211676 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5" Jul 08 19:44:39.211758 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:39.211691 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5" event={"ID":"285fbfe1-151b-4fe1-a2b3-69f66b2ecfba","Type":"ContainerDied","Data":"c5e37771d39258bf3a088f8c728d8826b465ae89df4b0f6d1b55c7a066933760"} Jul 08 19:44:39.211758 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:39.211739 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5e37771d39258bf3a088f8c728d8826b465ae89df4b0f6d1b55c7a066933760" Jul 08 19:44:39.213553 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:39.213528 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" event={"ID":"2af2ec91-cc70-4720-8753-0c8a1a842516","Type":"ContainerDied","Data":"c15f85e52ae06baa5c136e295b300de635bd066f744d5338d2189cefa08b85d7"} Jul 08 19:44:39.213673 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:39.213566 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c15f85e52ae06baa5c136e295b300de635bd066f744d5338d2189cefa08b85d7" Jul 08 19:44:39.213673 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:39.213568 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf" Jul 08 19:44:47.437543 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.437507 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-768cdb6974-dhwj9"] Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438617 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a3fd6f4-c46f-46f9-831a-e95274a6d18f" containerName="extract" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438642 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a3fd6f4-c46f-46f9-831a-e95274a6d18f" containerName="extract" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438656 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2af2ec91-cc70-4720-8753-0c8a1a842516" containerName="pull" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438665 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2af2ec91-cc70-4720-8753-0c8a1a842516" containerName="pull" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438680 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b35c1f00-0866-44ca-8314-1497603a30fa" containerName="extract" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438689 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b35c1f00-0866-44ca-8314-1497603a30fa" containerName="extract" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438703 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="285fbfe1-151b-4fe1-a2b3-69f66b2ecfba" containerName="util" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438711 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="285fbfe1-151b-4fe1-a2b3-69f66b2ecfba" containerName="util" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438723 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a3fd6f4-c46f-46f9-831a-e95274a6d18f" containerName="util" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438732 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a3fd6f4-c46f-46f9-831a-e95274a6d18f" containerName="util" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438745 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2af2ec91-cc70-4720-8753-0c8a1a842516" containerName="extract" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438753 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2af2ec91-cc70-4720-8753-0c8a1a842516" containerName="extract" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438766 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b35c1f00-0866-44ca-8314-1497603a30fa" containerName="pull" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438773 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b35c1f00-0866-44ca-8314-1497603a30fa" containerName="pull" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438784 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2af2ec91-cc70-4720-8753-0c8a1a842516" containerName="util" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438791 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2af2ec91-cc70-4720-8753-0c8a1a842516" containerName="util" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438803 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b35c1f00-0866-44ca-8314-1497603a30fa" containerName="util" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438811 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b35c1f00-0866-44ca-8314-1497603a30fa" containerName="util" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438819 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="285fbfe1-151b-4fe1-a2b3-69f66b2ecfba" containerName="pull" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438827 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="285fbfe1-151b-4fe1-a2b3-69f66b2ecfba" containerName="pull" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438839 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="285fbfe1-151b-4fe1-a2b3-69f66b2ecfba" containerName="extract" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438847 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="285fbfe1-151b-4fe1-a2b3-69f66b2ecfba" containerName="extract" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438866 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a3fd6f4-c46f-46f9-831a-e95274a6d18f" containerName="pull" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438874 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a3fd6f4-c46f-46f9-831a-e95274a6d18f" containerName="pull" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438968 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a3fd6f4-c46f-46f9-831a-e95274a6d18f" containerName="extract" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438983 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="2af2ec91-cc70-4720-8753-0c8a1a842516" containerName="extract" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.438994 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b35c1f00-0866-44ca-8314-1497603a30fa" containerName="extract" Jul 08 19:44:47.440063 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.439004 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="285fbfe1-151b-4fe1-a2b3-69f66b2ecfba" containerName="extract" Jul 08 19:44:47.442614 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.442592 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.456535 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.456510 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-768cdb6974-dhwj9"] Jul 08 19:44:47.542835 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.542785 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-console-config\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.543007 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.542843 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-console-serving-cert\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.543007 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.542890 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-trusted-ca-bundle\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.543007 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.542939 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnxrd\" (UniqueName: \"kubernetes.io/projected/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-kube-api-access-gnxrd\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.543181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.543007 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-console-oauth-config\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.543181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.543032 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-oauth-serving-cert\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.543181 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.543077 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-service-ca\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.643506 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.643473 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-trusted-ca-bundle\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.643707 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.643522 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnxrd\" (UniqueName: \"kubernetes.io/projected/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-kube-api-access-gnxrd\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.643707 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.643564 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-console-oauth-config\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.643707 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.643579 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-oauth-serving-cert\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.643707 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.643606 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-service-ca\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.643941 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.643754 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-console-config\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.643941 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.643794 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-console-serving-cert\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.644458 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.644412 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-service-ca\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.644563 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.644413 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-trusted-ca-bundle\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.644563 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.644412 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-oauth-serving-cert\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.644637 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.644590 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-console-config\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.646036 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.646015 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-console-serving-cert\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.646127 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.646112 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-console-oauth-config\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.656098 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.656076 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnxrd\" (UniqueName: \"kubernetes.io/projected/ab854b63-2b1b-4c8b-a9e6-3e44b5394258-kube-api-access-gnxrd\") pod \"console-768cdb6974-dhwj9\" (UID: \"ab854b63-2b1b-4c8b-a9e6-3e44b5394258\") " pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.756695 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.756631 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:47.896841 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:47.896814 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-768cdb6974-dhwj9"] Jul 08 19:44:47.898263 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:44:47.898240 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab854b63_2b1b_4c8b_a9e6_3e44b5394258.slice/crio-5edfd6815ec1082bb5ddf660335f0e28d26ad5920e401c86484b2201768b3bab WatchSource:0}: Error finding container 5edfd6815ec1082bb5ddf660335f0e28d26ad5920e401c86484b2201768b3bab: Status 404 returned error can't find the container with id 5edfd6815ec1082bb5ddf660335f0e28d26ad5920e401c86484b2201768b3bab Jul 08 19:44:48.263711 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:48.263672 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-768cdb6974-dhwj9" event={"ID":"ab854b63-2b1b-4c8b-a9e6-3e44b5394258","Type":"ContainerStarted","Data":"a27b6269edb6d1390dbd795558aae0cbef4b5f05177cfc17b959cf92ae45002d"} Jul 08 19:44:48.263915 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:48.263725 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-768cdb6974-dhwj9" event={"ID":"ab854b63-2b1b-4c8b-a9e6-3e44b5394258","Type":"ContainerStarted","Data":"5edfd6815ec1082bb5ddf660335f0e28d26ad5920e401c86484b2201768b3bab"} Jul 08 19:44:48.283729 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:48.283676 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-768cdb6974-dhwj9" podStartSLOduration=1.283661854 podStartE2EDuration="1.283661854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:44:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:44:48.281606369 +0000 UTC m=+610.035250610" watchObservedRunningTime="2026-07-08 19:44:48.283661854 +0000 UTC m=+610.037306381" Jul 08 19:44:57.756906 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:57.756872 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:57.757296 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:57.756919 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:57.761733 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:57.761713 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:58.325146 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:58.325112 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-768cdb6974-dhwj9" Jul 08 19:44:58.388733 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:44:58.388704 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bb59844f7-hrnss"] Jul 08 19:45:00.293912 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:00.293882 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5"] Jul 08 19:45:00.297603 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:00.297586 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5" Jul 08 19:45:00.300989 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:00.300959 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 19:45:00.302071 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:00.302052 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-j985g\"" Jul 08 19:45:00.302160 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:00.302113 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 19:45:00.312395 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:00.312369 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5"] Jul 08 19:45:00.359623 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:00.359597 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64gp8\" (UniqueName: \"kubernetes.io/projected/4c8b87f2-9663-4bb8-bdbe-9373469d0997-kube-api-access-64gp8\") pod \"limitador-operator-controller-manager-859d7b78bd-lz9f5\" (UID: \"4c8b87f2-9663-4bb8-bdbe-9373469d0997\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5" Jul 08 19:45:00.460402 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:00.460373 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64gp8\" (UniqueName: \"kubernetes.io/projected/4c8b87f2-9663-4bb8-bdbe-9373469d0997-kube-api-access-64gp8\") pod \"limitador-operator-controller-manager-859d7b78bd-lz9f5\" (UID: \"4c8b87f2-9663-4bb8-bdbe-9373469d0997\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5" Jul 08 19:45:00.469593 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:00.469570 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64gp8\" (UniqueName: \"kubernetes.io/projected/4c8b87f2-9663-4bb8-bdbe-9373469d0997-kube-api-access-64gp8\") pod \"limitador-operator-controller-manager-859d7b78bd-lz9f5\" (UID: \"4c8b87f2-9663-4bb8-bdbe-9373469d0997\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5" Jul 08 19:45:00.608049 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:00.607977 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5" Jul 08 19:45:00.748215 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:00.748193 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5"] Jul 08 19:45:00.749998 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:45:00.749967 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c8b87f2_9663_4bb8_bdbe_9373469d0997.slice/crio-f0bb01571bccc090c5142bdeeaa3e533a9d3897bcb37b5e6440550865d246d7e WatchSource:0}: Error finding container f0bb01571bccc090c5142bdeeaa3e533a9d3897bcb37b5e6440550865d246d7e: Status 404 returned error can't find the container with id f0bb01571bccc090c5142bdeeaa3e533a9d3897bcb37b5e6440550865d246d7e Jul 08 19:45:00.752068 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:00.752052 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:45:01.336499 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:01.336461 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5" event={"ID":"4c8b87f2-9663-4bb8-bdbe-9373469d0997","Type":"ContainerStarted","Data":"f0bb01571bccc090c5142bdeeaa3e533a9d3897bcb37b5e6440550865d246d7e"} Jul 08 19:45:03.349223 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:03.349187 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5" event={"ID":"4c8b87f2-9663-4bb8-bdbe-9373469d0997","Type":"ContainerStarted","Data":"249f39c3c822ce64207248a8773797146c6f78f548fbab23a63570e2be81608b"} Jul 08 19:45:03.349689 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:03.349267 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5" Jul 08 19:45:03.378724 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:03.378680 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5" podStartSLOduration=0.949891185 podStartE2EDuration="3.378664872s" totalImagesPullingTime="2.428773687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:45:03.376967278 +0000 UTC m=+625.130611520" watchObservedRunningTime="2026-07-08 19:45:03.378664872 +0000 UTC m=+625.132309114" Jul 08 19:45:14.357753 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.357719 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5" Jul 08 19:45:14.591515 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.591480 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm"] Jul 08 19:45:14.596721 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.596700 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm" Jul 08 19:45:14.599242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.599218 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fgplz\"" Jul 08 19:45:14.609345 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.609292 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm"] Jul 08 19:45:14.675287 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.675258 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm"] Jul 08 19:45:14.675624 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:45:14.675599 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-55mcx], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm" podUID="44485c64-923a-47ff-9b45-355385876ac2" Jul 08 19:45:14.679702 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.679675 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm"] Jul 08 19:45:14.694031 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.693997 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44485c64-923a-47ff-9b45-355385876ac2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5gqcm\" (UID: \"44485c64-923a-47ff-9b45-355385876ac2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm" Jul 08 19:45:14.694157 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.694064 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55mcx\" (UniqueName: \"kubernetes.io/projected/44485c64-923a-47ff-9b45-355385876ac2-kube-api-access-55mcx\") pod \"kuadrant-operator-controller-manager-86878c769f-5gqcm\" (UID: \"44485c64-923a-47ff-9b45-355385876ac2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm" Jul 08 19:45:14.695965 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.695944 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5"] Jul 08 19:45:14.696140 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.696120 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5" podUID="4c8b87f2-9663-4bb8-bdbe-9373469d0997" containerName="manager" containerID="cri-o://249f39c3c822ce64207248a8773797146c6f78f548fbab23a63570e2be81608b" gracePeriod=2 Jul 08 19:45:14.704081 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.704029 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q9652"] Jul 08 19:45:14.709054 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.709033 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5"] Jul 08 19:45:14.709296 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.709123 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q9652" Jul 08 19:45:14.724755 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.724728 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q9652"] Jul 08 19:45:14.751861 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:45:14.751769 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lz9f5\" is forbidden: User \"system:node:ip-10-0-138-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-108.ec2.internal' and this object" podUID="4c8b87f2-9663-4bb8-bdbe-9373469d0997" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5" Jul 08 19:45:14.752121 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.752098 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vh2s8"] Jul 08 19:45:14.752568 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.752549 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c8b87f2-9663-4bb8-bdbe-9373469d0997" containerName="manager" Jul 08 19:45:14.752568 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.752568 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c8b87f2-9663-4bb8-bdbe-9373469d0997" containerName="manager" Jul 08 19:45:14.752717 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.752653 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c8b87f2-9663-4bb8-bdbe-9373469d0997" containerName="manager" Jul 08 19:45:14.755849 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.755830 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vh2s8" Jul 08 19:45:14.769769 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.769748 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vh2s8"] Jul 08 19:45:14.781760 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.781730 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44485c64-923a-47ff-9b45-355385876ac2" path="/var/lib/kubelet/pods/44485c64-923a-47ff-9b45-355385876ac2/volumes" Jul 08 19:45:14.794882 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.794859 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55mcx\" (UniqueName: \"kubernetes.io/projected/44485c64-923a-47ff-9b45-355385876ac2-kube-api-access-55mcx\") pod \"kuadrant-operator-controller-manager-86878c769f-5gqcm\" (UID: \"44485c64-923a-47ff-9b45-355385876ac2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm" Jul 08 19:45:14.794990 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.794927 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b492725-3606-4f26-923e-a7d4c9a77288-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q9652\" (UID: \"3b492725-3606-4f26-923e-a7d4c9a77288\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q9652" Jul 08 19:45:14.794990 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.794959 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhzbs\" (UniqueName: \"kubernetes.io/projected/3b492725-3606-4f26-923e-a7d4c9a77288-kube-api-access-jhzbs\") pod \"kuadrant-operator-controller-manager-86878c769f-q9652\" (UID: \"3b492725-3606-4f26-923e-a7d4c9a77288\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q9652" Jul 08 19:45:14.795142 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.795116 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44485c64-923a-47ff-9b45-355385876ac2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5gqcm\" (UID: \"44485c64-923a-47ff-9b45-355385876ac2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm" Jul 08 19:45:14.795669 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.795647 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44485c64-923a-47ff-9b45-355385876ac2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5gqcm\" (UID: \"44485c64-923a-47ff-9b45-355385876ac2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm" Jul 08 19:45:14.795725 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:45:14.795691 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-lz9f5\" is forbidden: User \"system:node:ip-10-0-138-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-108.ec2.internal' and this object" podUID="4c8b87f2-9663-4bb8-bdbe-9373469d0997" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5" Jul 08 19:45:14.800941 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:45:14.800922 2553 projected.go:196] Error preparing data for projected volume kube-api-access-55mcx for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-5gqcm" not found Jul 08 19:45:14.801037 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:45:14.800992 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44485c64-923a-47ff-9b45-355385876ac2-kube-api-access-55mcx podName:44485c64-923a-47ff-9b45-355385876ac2 nodeName:}" failed. No retries permitted until 2026-07-08 19:45:15.300971367 +0000 UTC m=+637.054615595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-55mcx" (UniqueName: "kubernetes.io/projected/44485c64-923a-47ff-9b45-355385876ac2-kube-api-access-55mcx") pod "kuadrant-operator-controller-manager-86878c769f-5gqcm" (UID: "44485c64-923a-47ff-9b45-355385876ac2") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-5gqcm" not found Jul 08 19:45:14.896048 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.896018 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swtqb\" (UniqueName: \"kubernetes.io/projected/d483b169-59d5-4bc7-98f9-642326a5cfb3-kube-api-access-swtqb\") pod \"limitador-operator-controller-manager-859d7b78bd-vh2s8\" (UID: \"d483b169-59d5-4bc7-98f9-642326a5cfb3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vh2s8" Jul 08 19:45:14.896182 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.896065 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b492725-3606-4f26-923e-a7d4c9a77288-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q9652\" (UID: \"3b492725-3606-4f26-923e-a7d4c9a77288\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q9652" Jul 08 19:45:14.896182 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.896085 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhzbs\" (UniqueName: \"kubernetes.io/projected/3b492725-3606-4f26-923e-a7d4c9a77288-kube-api-access-jhzbs\") pod \"kuadrant-operator-controller-manager-86878c769f-q9652\" (UID: \"3b492725-3606-4f26-923e-a7d4c9a77288\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q9652" Jul 08 19:45:14.896537 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.896517 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b492725-3606-4f26-923e-a7d4c9a77288-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q9652\" (UID: \"3b492725-3606-4f26-923e-a7d4c9a77288\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q9652" Jul 08 19:45:14.917138 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.917118 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhzbs\" (UniqueName: \"kubernetes.io/projected/3b492725-3606-4f26-923e-a7d4c9a77288-kube-api-access-jhzbs\") pod \"kuadrant-operator-controller-manager-86878c769f-q9652\" (UID: \"3b492725-3606-4f26-923e-a7d4c9a77288\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q9652" Jul 08 19:45:14.950214 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.950190 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5" Jul 08 19:45:14.997451 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:14.997413 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swtqb\" (UniqueName: \"kubernetes.io/projected/d483b169-59d5-4bc7-98f9-642326a5cfb3-kube-api-access-swtqb\") pod \"limitador-operator-controller-manager-859d7b78bd-vh2s8\" (UID: \"d483b169-59d5-4bc7-98f9-642326a5cfb3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vh2s8" Jul 08 19:45:15.016725 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.016703 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swtqb\" (UniqueName: \"kubernetes.io/projected/d483b169-59d5-4bc7-98f9-642326a5cfb3-kube-api-access-swtqb\") pod \"limitador-operator-controller-manager-859d7b78bd-vh2s8\" (UID: \"d483b169-59d5-4bc7-98f9-642326a5cfb3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vh2s8" Jul 08 19:45:15.078777 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.078747 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q9652" Jul 08 19:45:15.084704 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.084687 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vh2s8" Jul 08 19:45:15.097984 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.097932 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64gp8\" (UniqueName: \"kubernetes.io/projected/4c8b87f2-9663-4bb8-bdbe-9373469d0997-kube-api-access-64gp8\") pod \"4c8b87f2-9663-4bb8-bdbe-9373469d0997\" (UID: \"4c8b87f2-9663-4bb8-bdbe-9373469d0997\") " Jul 08 19:45:15.099901 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.099872 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c8b87f2-9663-4bb8-bdbe-9373469d0997-kube-api-access-64gp8" (OuterVolumeSpecName: "kube-api-access-64gp8") pod "4c8b87f2-9663-4bb8-bdbe-9373469d0997" (UID: "4c8b87f2-9663-4bb8-bdbe-9373469d0997"). InnerVolumeSpecName "kube-api-access-64gp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:45:15.199233 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.199192 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64gp8\" (UniqueName: \"kubernetes.io/projected/4c8b87f2-9663-4bb8-bdbe-9373469d0997-kube-api-access-64gp8\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:45:15.227490 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.227309 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q9652"] Jul 08 19:45:15.230005 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:45:15.229980 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b492725_3606_4f26_923e_a7d4c9a77288.slice/crio-f315f602ae074c1892ad54e7a4099564c187ba90f949600cf450969aed053702 WatchSource:0}: Error finding container f315f602ae074c1892ad54e7a4099564c187ba90f949600cf450969aed053702: Status 404 returned error can't find the container with id f315f602ae074c1892ad54e7a4099564c187ba90f949600cf450969aed053702 Jul 08 19:45:15.250577 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.250555 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vh2s8"] Jul 08 19:45:15.251767 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:45:15.251749 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd483b169_59d5_4bc7_98f9_642326a5cfb3.slice/crio-69c06da7480cd1ba94e84dc1b9e91d594dec309d1067a26a2a9584ebe81b29b7 WatchSource:0}: Error finding container 69c06da7480cd1ba94e84dc1b9e91d594dec309d1067a26a2a9584ebe81b29b7: Status 404 returned error can't find the container with id 69c06da7480cd1ba94e84dc1b9e91d594dec309d1067a26a2a9584ebe81b29b7 Jul 08 19:45:15.401292 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.401210 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55mcx\" (UniqueName: \"kubernetes.io/projected/44485c64-923a-47ff-9b45-355385876ac2-kube-api-access-55mcx\") pod \"kuadrant-operator-controller-manager-86878c769f-5gqcm\" (UID: \"44485c64-923a-47ff-9b45-355385876ac2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm" Jul 08 19:45:15.404142 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:45:15.404120 2553 projected.go:196] Error preparing data for projected volume kube-api-access-55mcx for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-5gqcm" not found Jul 08 19:45:15.404258 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:45:15.404185 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44485c64-923a-47ff-9b45-355385876ac2-kube-api-access-55mcx podName:44485c64-923a-47ff-9b45-355385876ac2 nodeName:}" failed. No retries permitted until 2026-07-08 19:45:16.404166576 +0000 UTC m=+638.157810798 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-55mcx" (UniqueName: "kubernetes.io/projected/44485c64-923a-47ff-9b45-355385876ac2-kube-api-access-55mcx") pod "kuadrant-operator-controller-manager-86878c769f-5gqcm" (UID: "44485c64-923a-47ff-9b45-355385876ac2") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-5gqcm" not found Jul 08 19:45:15.419834 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.419807 2553 generic.go:356] "Generic (PLEG): container finished" podID="4c8b87f2-9663-4bb8-bdbe-9373469d0997" containerID="249f39c3c822ce64207248a8773797146c6f78f548fbab23a63570e2be81608b" exitCode=0 Jul 08 19:45:15.419960 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.419855 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lz9f5" Jul 08 19:45:15.419960 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.419910 2553 scope.go:117] "RemoveContainer" containerID="249f39c3c822ce64207248a8773797146c6f78f548fbab23a63570e2be81608b" Jul 08 19:45:15.421484 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.421460 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q9652" event={"ID":"3b492725-3606-4f26-923e-a7d4c9a77288","Type":"ContainerStarted","Data":"f315f602ae074c1892ad54e7a4099564c187ba90f949600cf450969aed053702"} Jul 08 19:45:15.423400 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.423366 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vh2s8" event={"ID":"d483b169-59d5-4bc7-98f9-642326a5cfb3","Type":"ContainerStarted","Data":"06f1d6ae0148e666f3831369f852252b10887177a6e88e960acd7faff7ee861a"} Jul 08 19:45:15.423400 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.423393 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm" Jul 08 19:45:15.423641 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.423429 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vh2s8" event={"ID":"d483b169-59d5-4bc7-98f9-642326a5cfb3","Type":"ContainerStarted","Data":"69c06da7480cd1ba94e84dc1b9e91d594dec309d1067a26a2a9584ebe81b29b7"} Jul 08 19:45:15.423641 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.423485 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vh2s8" Jul 08 19:45:15.429971 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.429954 2553 scope.go:117] "RemoveContainer" containerID="249f39c3c822ce64207248a8773797146c6f78f548fbab23a63570e2be81608b" Jul 08 19:45:15.430218 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:45:15.430193 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"249f39c3c822ce64207248a8773797146c6f78f548fbab23a63570e2be81608b\": container with ID starting with 249f39c3c822ce64207248a8773797146c6f78f548fbab23a63570e2be81608b not found: ID does not exist" containerID="249f39c3c822ce64207248a8773797146c6f78f548fbab23a63570e2be81608b" Jul 08 19:45:15.430273 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.430229 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"249f39c3c822ce64207248a8773797146c6f78f548fbab23a63570e2be81608b"} err="failed to get container status \"249f39c3c822ce64207248a8773797146c6f78f548fbab23a63570e2be81608b\": rpc error: code = NotFound desc = could not find container \"249f39c3c822ce64207248a8773797146c6f78f548fbab23a63570e2be81608b\": container with ID starting with 249f39c3c822ce64207248a8773797146c6f78f548fbab23a63570e2be81608b not found: ID does not exist" Jul 08 19:45:15.437662 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.437644 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm" Jul 08 19:45:15.444646 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.444607 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vh2s8" podStartSLOduration=1.4445951479999999 podStartE2EDuration="1.444595148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:45:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:45:15.442225383 +0000 UTC m=+637.195869651" watchObservedRunningTime="2026-07-08 19:45:15.444595148 +0000 UTC m=+637.198239388" Jul 08 19:45:15.446054 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:45:15.446027 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-5gqcm\" is forbidden: User \"system:node:ip-10-0-138-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-108.ec2.internal' and this object" podUID="44485c64-923a-47ff-9b45-355385876ac2" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm" Jul 08 19:45:15.602933 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.602899 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44485c64-923a-47ff-9b45-355385876ac2-extensions-socket-volume\") pod \"44485c64-923a-47ff-9b45-355385876ac2\" (UID: \"44485c64-923a-47ff-9b45-355385876ac2\") " Jul 08 19:45:15.603126 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.603112 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55mcx\" (UniqueName: \"kubernetes.io/projected/44485c64-923a-47ff-9b45-355385876ac2-kube-api-access-55mcx\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:45:15.603174 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.603127 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44485c64-923a-47ff-9b45-355385876ac2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "44485c64-923a-47ff-9b45-355385876ac2" (UID: "44485c64-923a-47ff-9b45-355385876ac2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:45:15.704355 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:15.704286 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44485c64-923a-47ff-9b45-355385876ac2-extensions-socket-volume\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:45:16.429494 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:16.429468 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm" Jul 08 19:45:16.432305 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:45:16.432279 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-5gqcm\" is forbidden: User \"system:node:ip-10-0-138-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-108.ec2.internal' and this object" podUID="44485c64-923a-47ff-9b45-355385876ac2" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm" Jul 08 19:45:16.437455 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:45:16.437412 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-5gqcm\" is forbidden: User \"system:node:ip-10-0-138-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-108.ec2.internal' and this object" podUID="44485c64-923a-47ff-9b45-355385876ac2" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5gqcm" Jul 08 19:45:16.780862 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:16.780835 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44485c64-923a-47ff-9b45-355385876ac2" path="/var/lib/kubelet/pods/44485c64-923a-47ff-9b45-355385876ac2/volumes" Jul 08 19:45:16.781092 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:16.781078 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c8b87f2-9663-4bb8-bdbe-9373469d0997" path="/var/lib/kubelet/pods/4c8b87f2-9663-4bb8-bdbe-9373469d0997/volumes" Jul 08 19:45:20.455581 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:20.455544 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q9652" event={"ID":"3b492725-3606-4f26-923e-a7d4c9a77288","Type":"ContainerStarted","Data":"2f455ad5247a9eea470e212619def401a15e53e690576aaecc1810841baafcfa"} Jul 08 19:45:20.456002 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:20.455615 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q9652" Jul 08 19:45:20.485579 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:20.485535 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q9652" podStartSLOduration=1.392062413 podStartE2EDuration="6.485519846s" totalImagesPullingTime="5.093457433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:45:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:45:20.483919364 +0000 UTC m=+642.237563640" watchObservedRunningTime="2026-07-08 19:45:20.485519846 +0000 UTC m=+642.239164087" Jul 08 19:45:23.409404 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.409363 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bb59844f7-hrnss" podUID="135a6301-f6af-45dd-b800-cdd49ef2c546" containerName="console" containerID="cri-o://36e4754538437b6fc5774e19d1fe2154788ff91e74f1129d71622aafc44c7e6a" gracePeriod=15 Jul 08 19:45:23.665520 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.665463 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:45:23.780104 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.780077 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-trusted-ca-bundle\") pod \"135a6301-f6af-45dd-b800-cdd49ef2c546\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " Jul 08 19:45:23.780104 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.780106 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-oauth-serving-cert\") pod \"135a6301-f6af-45dd-b800-cdd49ef2c546\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " Jul 08 19:45:23.780354 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.780136 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/135a6301-f6af-45dd-b800-cdd49ef2c546-console-serving-cert\") pod \"135a6301-f6af-45dd-b800-cdd49ef2c546\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " Jul 08 19:45:23.780354 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.780155 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/135a6301-f6af-45dd-b800-cdd49ef2c546-console-oauth-config\") pod \"135a6301-f6af-45dd-b800-cdd49ef2c546\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " Jul 08 19:45:23.780354 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.780209 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-service-ca\") pod \"135a6301-f6af-45dd-b800-cdd49ef2c546\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " Jul 08 19:45:23.780354 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.780242 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kttkz\" (UniqueName: \"kubernetes.io/projected/135a6301-f6af-45dd-b800-cdd49ef2c546-kube-api-access-kttkz\") pod \"135a6301-f6af-45dd-b800-cdd49ef2c546\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " Jul 08 19:45:23.780354 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.780266 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-console-config\") pod \"135a6301-f6af-45dd-b800-cdd49ef2c546\" (UID: \"135a6301-f6af-45dd-b800-cdd49ef2c546\") " Jul 08 19:45:23.780653 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.780634 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "135a6301-f6af-45dd-b800-cdd49ef2c546" (UID: "135a6301-f6af-45dd-b800-cdd49ef2c546"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:45:23.780716 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.780651 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "135a6301-f6af-45dd-b800-cdd49ef2c546" (UID: "135a6301-f6af-45dd-b800-cdd49ef2c546"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:45:23.780791 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.780764 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-console-config" (OuterVolumeSpecName: "console-config") pod "135a6301-f6af-45dd-b800-cdd49ef2c546" (UID: "135a6301-f6af-45dd-b800-cdd49ef2c546"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:45:23.780862 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.780838 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-service-ca" (OuterVolumeSpecName: "service-ca") pod "135a6301-f6af-45dd-b800-cdd49ef2c546" (UID: "135a6301-f6af-45dd-b800-cdd49ef2c546"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:45:23.782267 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.782240 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/135a6301-f6af-45dd-b800-cdd49ef2c546-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "135a6301-f6af-45dd-b800-cdd49ef2c546" (UID: "135a6301-f6af-45dd-b800-cdd49ef2c546"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:45:23.782332 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.782274 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/135a6301-f6af-45dd-b800-cdd49ef2c546-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "135a6301-f6af-45dd-b800-cdd49ef2c546" (UID: "135a6301-f6af-45dd-b800-cdd49ef2c546"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:45:23.782448 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.782406 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/135a6301-f6af-45dd-b800-cdd49ef2c546-kube-api-access-kttkz" (OuterVolumeSpecName: "kube-api-access-kttkz") pod "135a6301-f6af-45dd-b800-cdd49ef2c546" (UID: "135a6301-f6af-45dd-b800-cdd49ef2c546"). InnerVolumeSpecName "kube-api-access-kttkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:45:23.881546 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.881517 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-trusted-ca-bundle\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:45:23.881546 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.881543 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-oauth-serving-cert\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:45:23.881546 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.881552 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/135a6301-f6af-45dd-b800-cdd49ef2c546-console-serving-cert\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:45:23.881758 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.881560 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/135a6301-f6af-45dd-b800-cdd49ef2c546-console-oauth-config\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:45:23.881758 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.881569 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-service-ca\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:45:23.881758 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.881577 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kttkz\" (UniqueName: \"kubernetes.io/projected/135a6301-f6af-45dd-b800-cdd49ef2c546-kube-api-access-kttkz\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:45:23.881758 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:23.881586 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/135a6301-f6af-45dd-b800-cdd49ef2c546-console-config\") on node \"ip-10-0-138-108.ec2.internal\" DevicePath \"\"" Jul 08 19:45:24.480329 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:24.480298 2553 generic.go:356] "Generic (PLEG): container finished" podID="135a6301-f6af-45dd-b800-cdd49ef2c546" containerID="36e4754538437b6fc5774e19d1fe2154788ff91e74f1129d71622aafc44c7e6a" exitCode=0 Jul 08 19:45:24.480818 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:24.480344 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb59844f7-hrnss" Jul 08 19:45:24.480818 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:24.480389 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb59844f7-hrnss" event={"ID":"135a6301-f6af-45dd-b800-cdd49ef2c546","Type":"ContainerDied","Data":"36e4754538437b6fc5774e19d1fe2154788ff91e74f1129d71622aafc44c7e6a"} Jul 08 19:45:24.480818 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:24.480454 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb59844f7-hrnss" event={"ID":"135a6301-f6af-45dd-b800-cdd49ef2c546","Type":"ContainerDied","Data":"cf04e6761733f17a77a94d720a0b9a08e3b8ccbe08cecd65406cb82ddca0aa6d"} Jul 08 19:45:24.480818 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:24.480483 2553 scope.go:117] "RemoveContainer" containerID="36e4754538437b6fc5774e19d1fe2154788ff91e74f1129d71622aafc44c7e6a" Jul 08 19:45:24.490571 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:24.490553 2553 scope.go:117] "RemoveContainer" containerID="36e4754538437b6fc5774e19d1fe2154788ff91e74f1129d71622aafc44c7e6a" Jul 08 19:45:24.490853 ip-10-0-138-108 kubenswrapper[2553]: E0708 19:45:24.490835 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36e4754538437b6fc5774e19d1fe2154788ff91e74f1129d71622aafc44c7e6a\": container with ID starting with 36e4754538437b6fc5774e19d1fe2154788ff91e74f1129d71622aafc44c7e6a not found: ID does not exist" containerID="36e4754538437b6fc5774e19d1fe2154788ff91e74f1129d71622aafc44c7e6a" Jul 08 19:45:24.490901 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:24.490862 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36e4754538437b6fc5774e19d1fe2154788ff91e74f1129d71622aafc44c7e6a"} err="failed to get container status \"36e4754538437b6fc5774e19d1fe2154788ff91e74f1129d71622aafc44c7e6a\": rpc error: code = NotFound desc = could not find container \"36e4754538437b6fc5774e19d1fe2154788ff91e74f1129d71622aafc44c7e6a\": container with ID starting with 36e4754538437b6fc5774e19d1fe2154788ff91e74f1129d71622aafc44c7e6a not found: ID does not exist" Jul 08 19:45:24.515207 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:24.515170 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bb59844f7-hrnss"] Jul 08 19:45:24.520910 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:24.520891 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bb59844f7-hrnss"] Jul 08 19:45:24.779674 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:24.779643 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="135a6301-f6af-45dd-b800-cdd49ef2c546" path="/var/lib/kubelet/pods/135a6301-f6af-45dd-b800-cdd49ef2c546/volumes" Jul 08 19:45:26.432541 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:26.432511 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vh2s8" Jul 08 19:45:31.464619 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:45:31.464589 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q9652" Jul 08 19:46:37.070543 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:37.070458 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6h794_3d6dfda9-137f-4c35-84a0-9fb7b9edce9c/manager/0.log" Jul 08 19:46:37.187505 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:37.187469 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6pc72_fd74b967-2861-413c-8acc-326c4f6a69bc/manager/0.log" Jul 08 19:46:37.304412 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:37.304382 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6nkzw_6cfaae64-1d23-4079-85de-be74aef93262/server/0.log" Jul 08 19:46:37.567793 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:37.567766 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d8f46d496-5wllz_b2f53743-d6ba-4922-93fb-0d9d106f603e/copy-manifests/0.log" Jul 08 19:46:37.575555 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:37.575529 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d8f46d496-5wllz_b2f53743-d6ba-4922-93fb-0d9d106f603e/manager/0.log" Jul 08 19:46:38.567884 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:38.567856 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5_285fbfe1-151b-4fe1-a2b3-69f66b2ecfba/util/0.log" Jul 08 19:46:38.574020 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:38.573987 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5_285fbfe1-151b-4fe1-a2b3-69f66b2ecfba/pull/0.log" Jul 08 19:46:38.579834 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:38.579811 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5_285fbfe1-151b-4fe1-a2b3-69f66b2ecfba/extract/0.log" Jul 08 19:46:38.688123 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:38.688102 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm_b35c1f00-0866-44ca-8314-1497603a30fa/util/0.log" Jul 08 19:46:38.694070 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:38.694048 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm_b35c1f00-0866-44ca-8314-1497603a30fa/pull/0.log" Jul 08 19:46:38.699936 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:38.699910 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm_b35c1f00-0866-44ca-8314-1497603a30fa/extract/0.log" Jul 08 19:46:38.810263 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:38.810243 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm_8a3fd6f4-c46f-46f9-831a-e95274a6d18f/util/0.log" Jul 08 19:46:38.817517 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:38.817497 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm_8a3fd6f4-c46f-46f9-831a-e95274a6d18f/pull/0.log" Jul 08 19:46:38.824594 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:38.824517 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm_8a3fd6f4-c46f-46f9-831a-e95274a6d18f/extract/0.log" Jul 08 19:46:38.935841 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:38.935817 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf_2af2ec91-cc70-4720-8753-0c8a1a842516/util/0.log" Jul 08 19:46:38.944604 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:38.944585 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf_2af2ec91-cc70-4720-8753-0c8a1a842516/pull/0.log" Jul 08 19:46:38.950643 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:38.950627 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf_2af2ec91-cc70-4720-8753-0c8a1a842516/extract/0.log" Jul 08 19:46:39.647118 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:39.647087 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-q9652_3b492725-3606-4f26-923e-a7d4c9a77288/manager/0.log" Jul 08 19:46:39.876136 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:39.876107 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vh2s8_d483b169-59d5-4bc7-98f9-642326a5cfb3/manager/0.log" Jul 08 19:46:40.231449 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:40.231401 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4q5xj4_872ecbae-50b7-4833-9657-5822eef90a4a/istio-proxy/0.log" Jul 08 19:46:40.352207 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:40.352176 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2f8g4_63c7ed82-95ee-4fd3-bc19-eae5aaa814f0/discovery/0.log" Jul 08 19:46:40.575355 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:40.575331 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-769fbf6cd9-q6nks_1e45aa04-75ad-4665-8a03-0eaca2f5f7e5/kube-auth-proxy/0.log" Jul 08 19:46:48.093146 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:48.093112 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lrxb5_1fca35f1-b001-4ddc-99dd-c7069213abfb/global-pull-secret-syncer/0.log" Jul 08 19:46:48.166649 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:48.166617 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r8d4l_3adacc1d-0a88-4041-9e23-38c921877431/konnectivity-agent/0.log" Jul 08 19:46:48.259013 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:48.258975 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-108.ec2.internal_b7ec4acbf852e2b07ece08ecc1022c7c/haproxy/0.log" Jul 08 19:46:51.752857 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:51.752823 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5_285fbfe1-151b-4fe1-a2b3-69f66b2ecfba/extract/0.log" Jul 08 19:46:51.776230 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:51.776206 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5_285fbfe1-151b-4fe1-a2b3-69f66b2ecfba/util/0.log" Jul 08 19:46:51.797379 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:51.797351 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592lnl5_285fbfe1-151b-4fe1-a2b3-69f66b2ecfba/pull/0.log" Jul 08 19:46:51.825465 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:51.825429 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm_b35c1f00-0866-44ca-8314-1497603a30fa/extract/0.log" Jul 08 19:46:51.847423 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:51.847405 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm_b35c1f00-0866-44ca-8314-1497603a30fa/util/0.log" Jul 08 19:46:51.869029 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:51.869007 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xtvjm_b35c1f00-0866-44ca-8314-1497603a30fa/pull/0.log" Jul 08 19:46:51.893812 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:51.893790 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm_8a3fd6f4-c46f-46f9-831a-e95274a6d18f/extract/0.log" Jul 08 19:46:51.914841 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:51.914823 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm_8a3fd6f4-c46f-46f9-831a-e95274a6d18f/util/0.log" Jul 08 19:46:51.939986 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:51.939960 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738gvlm_8a3fd6f4-c46f-46f9-831a-e95274a6d18f/pull/0.log" Jul 08 19:46:51.978233 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:51.978199 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf_2af2ec91-cc70-4720-8753-0c8a1a842516/extract/0.log" Jul 08 19:46:52.002481 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:52.002462 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf_2af2ec91-cc70-4720-8753-0c8a1a842516/util/0.log" Jul 08 19:46:52.023367 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:52.023308 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1j7tzf_2af2ec91-cc70-4720-8753-0c8a1a842516/pull/0.log" Jul 08 19:46:52.254907 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:52.254877 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-q9652_3b492725-3606-4f26-923e-a7d4c9a77288/manager/0.log" Jul 08 19:46:52.323044 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:52.323019 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vh2s8_d483b169-59d5-4bc7-98f9-642326a5cfb3/manager/0.log" Jul 08 19:46:54.018641 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.018616 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_782bc28e-99b3-40ba-a4f6-5249c262fe0d/alertmanager/0.log" Jul 08 19:46:54.048261 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.048242 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_782bc28e-99b3-40ba-a4f6-5249c262fe0d/config-reloader/0.log" Jul 08 19:46:54.069244 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.069220 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_782bc28e-99b3-40ba-a4f6-5249c262fe0d/kube-rbac-proxy-web/0.log" Jul 08 19:46:54.091210 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.091187 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_782bc28e-99b3-40ba-a4f6-5249c262fe0d/kube-rbac-proxy/0.log" Jul 08 19:46:54.115682 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.115664 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_782bc28e-99b3-40ba-a4f6-5249c262fe0d/kube-rbac-proxy-metric/0.log" Jul 08 19:46:54.138810 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.138792 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_782bc28e-99b3-40ba-a4f6-5249c262fe0d/prom-label-proxy/0.log" Jul 08 19:46:54.161722 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.161702 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_782bc28e-99b3-40ba-a4f6-5249c262fe0d/init-config-reloader/0.log" Jul 08 19:46:54.228084 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.228059 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-xbkp8_a5a21740-6f8c-469f-a810-0ec194db1d62/kube-state-metrics/0.log" Jul 08 19:46:54.252109 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.252085 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-xbkp8_a5a21740-6f8c-469f-a810-0ec194db1d62/kube-rbac-proxy-main/0.log" Jul 08 19:46:54.272694 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.272638 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-xbkp8_a5a21740-6f8c-469f-a810-0ec194db1d62/kube-rbac-proxy-self/0.log" Jul 08 19:46:54.300385 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.300367 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-55cc7b7d9f-7svmw_764a6522-bd60-4373-a26e-fe67898f342f/metrics-server/0.log" Jul 08 19:46:54.438654 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.438631 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ll4dk_5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3/node-exporter/0.log" Jul 08 19:46:54.460915 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.460895 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ll4dk_5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3/kube-rbac-proxy/0.log" Jul 08 19:46:54.481264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.481245 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ll4dk_5c27fd7f-fee9-473d-87d4-e5dbe7f00ff3/init-textfile/0.log" Jul 08 19:46:54.842335 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.842305 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-dtwgb_d9e1337a-4870-492b-a157-98c8aee258e9/prometheus-operator/0.log" Jul 08 19:46:54.861987 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.861968 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-dtwgb_d9e1337a-4870-492b-a157-98c8aee258e9/kube-rbac-proxy/0.log" Jul 08 19:46:54.887214 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.887186 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-6qwwn_28b182f8-fa3c-4a5a-8018-ccd6cdf3d058/prometheus-operator-admission-webhook/0.log" Jul 08 19:46:54.922066 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.922044 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-775f7b5cf6-mkjgk_dd45707c-fe85-47f1-89d5-23bbba53f2d4/telemeter-client/0.log" Jul 08 19:46:54.945674 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.945650 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-775f7b5cf6-mkjgk_dd45707c-fe85-47f1-89d5-23bbba53f2d4/reload/0.log" Jul 08 19:46:54.995711 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:54.995688 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-775f7b5cf6-mkjgk_dd45707c-fe85-47f1-89d5-23bbba53f2d4/kube-rbac-proxy/0.log" Jul 08 19:46:57.376648 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:57.376601 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gh46n_9d41e4e9-4418-4797-acea-bca615f11b0f/console-operator/2.log" Jul 08 19:46:57.384699 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:57.384671 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gh46n_9d41e4e9-4418-4797-acea-bca615f11b0f/console-operator/3.log" Jul 08 19:46:57.916592 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:57.916566 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-768cdb6974-dhwj9_ab854b63-2b1b-4c8b-a9e6-3e44b5394258/console/0.log" Jul 08 19:46:57.949495 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:57.949464 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-gbdvb_62792e1e-c855-4450-9429-84cc68c896c9/download-server/0.log" Jul 08 19:46:58.529716 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.529676 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v"] Jul 08 19:46:58.530122 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.530107 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="135a6301-f6af-45dd-b800-cdd49ef2c546" containerName="console" Jul 08 19:46:58.530171 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.530125 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="135a6301-f6af-45dd-b800-cdd49ef2c546" containerName="console" Jul 08 19:46:58.530211 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.530200 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="135a6301-f6af-45dd-b800-cdd49ef2c546" containerName="console" Jul 08 19:46:58.532496 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.532480 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:46:58.535104 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.535078 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pzvtk\"/\"openshift-service-ca.crt\"" Jul 08 19:46:58.536540 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.536514 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pzvtk\"/\"kube-root-ca.crt\"" Jul 08 19:46:58.536655 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.536609 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pzvtk\"/\"default-dockercfg-z6p5z\"" Jul 08 19:46:58.539882 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.539862 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v"] Jul 08 19:46:58.626117 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.626089 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ab6ccb7-3892-4e1e-8345-22cd28cb17dd-proc\") pod \"perf-node-gather-daemonset-b5d6v\" (UID: \"7ab6ccb7-3892-4e1e-8345-22cd28cb17dd\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:46:58.626267 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.626131 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ab6ccb7-3892-4e1e-8345-22cd28cb17dd-podres\") pod \"perf-node-gather-daemonset-b5d6v\" (UID: \"7ab6ccb7-3892-4e1e-8345-22cd28cb17dd\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:46:58.626267 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.626206 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ab6ccb7-3892-4e1e-8345-22cd28cb17dd-sys\") pod \"perf-node-gather-daemonset-b5d6v\" (UID: \"7ab6ccb7-3892-4e1e-8345-22cd28cb17dd\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:46:58.626267 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.626260 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbp2p\" (UniqueName: \"kubernetes.io/projected/7ab6ccb7-3892-4e1e-8345-22cd28cb17dd-kube-api-access-hbp2p\") pod \"perf-node-gather-daemonset-b5d6v\" (UID: \"7ab6ccb7-3892-4e1e-8345-22cd28cb17dd\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:46:58.626385 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.626282 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ab6ccb7-3892-4e1e-8345-22cd28cb17dd-lib-modules\") pod \"perf-node-gather-daemonset-b5d6v\" (UID: \"7ab6ccb7-3892-4e1e-8345-22cd28cb17dd\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:46:58.727264 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.727241 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ab6ccb7-3892-4e1e-8345-22cd28cb17dd-proc\") pod \"perf-node-gather-daemonset-b5d6v\" (UID: \"7ab6ccb7-3892-4e1e-8345-22cd28cb17dd\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:46:58.727416 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.727278 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ab6ccb7-3892-4e1e-8345-22cd28cb17dd-podres\") pod \"perf-node-gather-daemonset-b5d6v\" (UID: \"7ab6ccb7-3892-4e1e-8345-22cd28cb17dd\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:46:58.727416 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.727305 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ab6ccb7-3892-4e1e-8345-22cd28cb17dd-sys\") pod \"perf-node-gather-daemonset-b5d6v\" (UID: \"7ab6ccb7-3892-4e1e-8345-22cd28cb17dd\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:46:58.727416 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.727339 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbp2p\" (UniqueName: \"kubernetes.io/projected/7ab6ccb7-3892-4e1e-8345-22cd28cb17dd-kube-api-access-hbp2p\") pod \"perf-node-gather-daemonset-b5d6v\" (UID: \"7ab6ccb7-3892-4e1e-8345-22cd28cb17dd\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:46:58.727416 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.727357 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ab6ccb7-3892-4e1e-8345-22cd28cb17dd-lib-modules\") pod \"perf-node-gather-daemonset-b5d6v\" (UID: \"7ab6ccb7-3892-4e1e-8345-22cd28cb17dd\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:46:58.727416 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.727359 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ab6ccb7-3892-4e1e-8345-22cd28cb17dd-proc\") pod \"perf-node-gather-daemonset-b5d6v\" (UID: \"7ab6ccb7-3892-4e1e-8345-22cd28cb17dd\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:46:58.727678 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.727453 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ab6ccb7-3892-4e1e-8345-22cd28cb17dd-sys\") pod \"perf-node-gather-daemonset-b5d6v\" (UID: \"7ab6ccb7-3892-4e1e-8345-22cd28cb17dd\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:46:58.727678 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.727431 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ab6ccb7-3892-4e1e-8345-22cd28cb17dd-podres\") pod \"perf-node-gather-daemonset-b5d6v\" (UID: \"7ab6ccb7-3892-4e1e-8345-22cd28cb17dd\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:46:58.727678 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.727491 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ab6ccb7-3892-4e1e-8345-22cd28cb17dd-lib-modules\") pod \"perf-node-gather-daemonset-b5d6v\" (UID: \"7ab6ccb7-3892-4e1e-8345-22cd28cb17dd\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:46:58.735500 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.735484 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbp2p\" (UniqueName: \"kubernetes.io/projected/7ab6ccb7-3892-4e1e-8345-22cd28cb17dd-kube-api-access-hbp2p\") pod \"perf-node-gather-daemonset-b5d6v\" (UID: \"7ab6ccb7-3892-4e1e-8345-22cd28cb17dd\") " pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:46:58.844068 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.843992 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:46:58.976385 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:58.976360 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v"] Jul 08 19:46:58.977965 ip-10-0-138-108 kubenswrapper[2553]: W0708 19:46:58.977936 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7ab6ccb7_3892_4e1e_8345_22cd28cb17dd.slice/crio-1ea1c51a46f7706a7f0fc2b1b859d7d666821556f2d20fd22bff9da99efbe097 WatchSource:0}: Error finding container 1ea1c51a46f7706a7f0fc2b1b859d7d666821556f2d20fd22bff9da99efbe097: Status 404 returned error can't find the container with id 1ea1c51a46f7706a7f0fc2b1b859d7d666821556f2d20fd22bff9da99efbe097 Jul 08 19:46:59.001131 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:59.001101 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" event={"ID":"7ab6ccb7-3892-4e1e-8345-22cd28cb17dd","Type":"ContainerStarted","Data":"1ea1c51a46f7706a7f0fc2b1b859d7d666821556f2d20fd22bff9da99efbe097"} Jul 08 19:46:59.680593 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:59.680566 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7wfgs_6449d116-2ee8-4113-904a-a03e258c4b6b/dns/0.log" Jul 08 19:46:59.701671 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:59.701652 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7wfgs_6449d116-2ee8-4113-904a-a03e258c4b6b/kube-rbac-proxy/0.log" Jul 08 19:46:59.824599 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:46:59.824568 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-krhqb_e507492c-7b39-427a-b189-5317fd33c4f4/dns-node-resolver/0.log" Jul 08 19:47:00.008565 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:00.008473 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" event={"ID":"7ab6ccb7-3892-4e1e-8345-22cd28cb17dd","Type":"ContainerStarted","Data":"d96838f1b65a54317005d8b5ed7c20b701b720bd70eac8788d425932cb1d96e0"} Jul 08 19:47:00.008714 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:00.008642 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:47:00.026278 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:00.026233 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" podStartSLOduration=2.026211414 podStartE2EDuration="2.026211414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:46:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:47:00.023732145 +0000 UTC m=+741.777376438" watchObservedRunningTime="2026-07-08 19:47:00.026211414 +0000 UTC m=+741.779855655" Jul 08 19:47:00.477242 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:00.477217 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qgvpz_ee19b31b-83ec-4cfd-9028-53489b1b36e2/node-ca/0.log" Jul 08 19:47:01.413709 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:01.413681 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4q5xj4_872ecbae-50b7-4833-9657-5822eef90a4a/istio-proxy/0.log" Jul 08 19:47:01.463576 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:01.463546 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2f8g4_63c7ed82-95ee-4fd3-bc19-eae5aaa814f0/discovery/0.log" Jul 08 19:47:01.511102 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:01.511073 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-769fbf6cd9-q6nks_1e45aa04-75ad-4665-8a03-0eaca2f5f7e5/kube-auth-proxy/0.log" Jul 08 19:47:02.211879 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:02.211852 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t6lq7_54fc0205-6a28-4930-93e0-f1f37776eaaa/serve-healthcheck-canary/0.log" Jul 08 19:47:02.675234 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:02.675198 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-gcp4k_a8078098-b1d0-4222-b1eb-9c116df84482/insights-operator/0.log" Jul 08 19:47:02.677080 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:02.677056 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-gcp4k_a8078098-b1d0-4222-b1eb-9c116df84482/insights-operator/1.log" Jul 08 19:47:02.841362 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:02.841336 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nj6f6_5ab8872b-42a7-4ea8-aee7-9cacdce8b974/kube-rbac-proxy/0.log" Jul 08 19:47:02.867852 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:02.867827 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nj6f6_5ab8872b-42a7-4ea8-aee7-9cacdce8b974/exporter/0.log" Jul 08 19:47:02.890134 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:02.890112 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nj6f6_5ab8872b-42a7-4ea8-aee7-9cacdce8b974/extractor/0.log" Jul 08 19:47:05.006042 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:05.006014 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6h794_3d6dfda9-137f-4c35-84a0-9fb7b9edce9c/manager/0.log" Jul 08 19:47:05.030866 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:05.030828 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6pc72_fd74b967-2861-413c-8acc-326c4f6a69bc/manager/0.log" Jul 08 19:47:05.052564 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:05.052547 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6nkzw_6cfaae64-1d23-4079-85de-be74aef93262/server/0.log" Jul 08 19:47:05.128541 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:05.128514 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d8f46d496-5wllz_b2f53743-d6ba-4922-93fb-0d9d106f603e/manager/0.log" Jul 08 19:47:05.150308 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:05.150277 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d8f46d496-5wllz_b2f53743-d6ba-4922-93fb-0d9d106f603e/copy-manifests/0.log" Jul 08 19:47:06.023494 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:06.023468 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pzvtk/perf-node-gather-daemonset-b5d6v" Jul 08 19:47:06.394469 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:06.394419 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-f9xbl_62775367-44c7-49c6-8498-e231d49778b4/openshift-lws-operator/0.log" Jul 08 19:47:08.269024 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:08.268934 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4q5xj4_872ecbae-50b7-4833-9657-5822eef90a4a/istio-proxy/0.log" Jul 08 19:47:08.314835 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:08.314806 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2f8g4_63c7ed82-95ee-4fd3-bc19-eae5aaa814f0/discovery/0.log" Jul 08 19:47:08.343711 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:08.343665 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-769fbf6cd9-q6nks_1e45aa04-75ad-4665-8a03-0eaca2f5f7e5/kube-auth-proxy/0.log" Jul 08 19:47:09.452989 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:09.452959 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4q5xj4_872ecbae-50b7-4833-9657-5822eef90a4a/istio-proxy/0.log" Jul 08 19:47:09.497551 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:09.497520 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2f8g4_63c7ed82-95ee-4fd3-bc19-eae5aaa814f0/discovery/0.log" Jul 08 19:47:09.527121 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:09.527096 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-769fbf6cd9-q6nks_1e45aa04-75ad-4665-8a03-0eaca2f5f7e5/kube-auth-proxy/0.log" Jul 08 19:47:12.013623 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:12.013596 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-cl26n_cde4c83a-9651-4090-8008-65ea0e65cdf0/kube-storage-version-migrator-operator/1.log" Jul 08 19:47:12.015254 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:12.015226 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-cl26n_cde4c83a-9651-4090-8008-65ea0e65cdf0/kube-storage-version-migrator-operator/0.log" Jul 08 19:47:13.405888 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:13.405858 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grmlv_ef87ff27-5173-4a5f-b14c-036905e7d02b/kube-multus-additional-cni-plugins/0.log" Jul 08 19:47:13.432781 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:13.432743 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grmlv_ef87ff27-5173-4a5f-b14c-036905e7d02b/egress-router-binary-copy/0.log" Jul 08 19:47:13.460171 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:13.460146 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grmlv_ef87ff27-5173-4a5f-b14c-036905e7d02b/cni-plugins/0.log" Jul 08 19:47:13.482520 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:13.482491 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grmlv_ef87ff27-5173-4a5f-b14c-036905e7d02b/bond-cni-plugin/0.log" Jul 08 19:47:13.510935 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:13.510911 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grmlv_ef87ff27-5173-4a5f-b14c-036905e7d02b/routeoverride-cni/0.log" Jul 08 19:47:13.535017 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:13.534998 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grmlv_ef87ff27-5173-4a5f-b14c-036905e7d02b/whereabouts-cni-bincopy/0.log" Jul 08 19:47:13.557216 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:13.557188 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grmlv_ef87ff27-5173-4a5f-b14c-036905e7d02b/whereabouts-cni/0.log" Jul 08 19:47:13.595420 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:13.595390 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j2mdw_677911c6-add4-47b7-8d4f-4cac25373bfa/kube-multus/0.log" Jul 08 19:47:13.724041 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:13.723963 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4n4kl_df97169f-20ad-4b99-b6c8-9cec807f0296/network-metrics-daemon/0.log" Jul 08 19:47:13.743091 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:13.743070 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4n4kl_df97169f-20ad-4b99-b6c8-9cec807f0296/kube-rbac-proxy/0.log" Jul 08 19:47:14.809214 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:14.809183 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9rnh_a2e57f9a-ec19-418b-bb13-f72ac6c49be0/ovn-controller/0.log" Jul 08 19:47:14.824751 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:14.824721 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9rnh_a2e57f9a-ec19-418b-bb13-f72ac6c49be0/ovn-acl-logging/0.log" Jul 08 19:47:14.855299 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:14.855278 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9rnh_a2e57f9a-ec19-418b-bb13-f72ac6c49be0/kube-rbac-proxy-node/0.log" Jul 08 19:47:14.880021 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:14.880001 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9rnh_a2e57f9a-ec19-418b-bb13-f72ac6c49be0/kube-rbac-proxy-ovn-metrics/0.log" Jul 08 19:47:14.897246 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:14.897228 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9rnh_a2e57f9a-ec19-418b-bb13-f72ac6c49be0/northd/0.log" Jul 08 19:47:14.917206 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:14.917154 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9rnh_a2e57f9a-ec19-418b-bb13-f72ac6c49be0/nbdb/0.log" Jul 08 19:47:14.937336 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:14.937313 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9rnh_a2e57f9a-ec19-418b-bb13-f72ac6c49be0/sbdb/0.log" Jul 08 19:47:14.998107 ip-10-0-138-108 kubenswrapper[2553]: I0708 19:47:14.998085 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9rnh_a2e57f9a-ec19-418b-bb13-f72ac6c49be0/ovnkube-controller/0.log"