Jun 03 15:00:10.869890 ip-10-0-130-78 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 15:00:10.869902 ip-10-0-130-78 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 15:00:10.869909 ip-10-0-130-78 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 15:00:10.870120 ip-10-0-130-78 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 15:00:20.931739 ip-10-0-130-78 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 15:00:20.931757 ip-10-0-130-78 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 02af326babbc437cb9192bbffe4c8897 -- Jun 03 15:02:52.518671 ip-10-0-130-78 systemd[1]: Starting Kubernetes Kubelet... Jun 03 15:02:52.984079 ip-10-0-130-78 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:02:52.984079 ip-10-0-130-78 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 15:02:52.984079 ip-10-0-130-78 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:02:52.984079 ip-10-0-130-78 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 15:02:52.984079 ip-10-0-130-78 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:02:52.987138 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.986995 2577 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 15:02:52.990596 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990580 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:02:52.990596 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990595 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990599 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990603 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990606 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990611 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990615 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990618 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990621 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990624 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990632 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990635 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990638 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990641 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990643 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990646 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990649 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990652 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990655 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990657 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:02:52.990657 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990660 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990663 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990666 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990669 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990672 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990675 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990677 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990680 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990682 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990685 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990688 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990691 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990694 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990696 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990699 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990701 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990705 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990707 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990710 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990712 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:02:52.991115 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990715 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990717 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990720 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990722 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990725 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990727 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990729 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990732 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990734 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990737 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990740 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990761 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990765 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990768 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990772 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990775 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990778 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990780 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990783 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990786 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:02:52.991649 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990788 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990791 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990794 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990796 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990799 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990802 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990806 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990809 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990812 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990815 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990818 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990821 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990823 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990826 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990828 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990832 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990835 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990838 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990840 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990843 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:02:52.992131 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990845 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990848 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990851 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990859 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990862 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.990865 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991906 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991915 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991918 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991921 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991925 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991928 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991930 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991933 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991936 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991939 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991942 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991944 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991947 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991963 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:02:52.992636 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991968 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991973 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991978 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991981 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991984 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991987 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991990 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991992 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991995 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.991998 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992000 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992003 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992006 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992008 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992011 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992014 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992016 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992021 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992026 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:02:52.993135 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992029 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992032 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992035 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992037 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992040 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992042 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992045 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992049 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992052 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992055 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992058 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992061 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992063 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992066 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992069 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992073 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992075 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992078 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992080 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:02:52.993619 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992083 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992085 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992088 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992090 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992093 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992095 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992098 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992101 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992104 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992107 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992109 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992112 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992115 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992117 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992121 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992124 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992126 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992129 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992131 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992134 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:02:52.994083 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992137 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992140 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992143 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992146 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992149 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992151 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992153 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992156 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992158 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992162 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992164 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992167 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992169 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.992172 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992761 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992771 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992778 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992783 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992787 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992791 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992796 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 15:02:52.994581 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992800 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992804 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992807 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992810 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992814 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992817 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992821 2577 flags.go:64] FLAG: --cgroup-root="" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992824 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992827 2577 flags.go:64] FLAG: --client-ca-file="" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992830 2577 flags.go:64] FLAG: --cloud-config="" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992833 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992836 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992840 2577 flags.go:64] FLAG: --cluster-domain="" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992843 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992846 2577 flags.go:64] FLAG: --config-dir="" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992849 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992853 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992856 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992860 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992863 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992866 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992871 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992874 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992877 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992880 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 15:02:52.995102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992883 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992888 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992891 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992894 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992898 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992901 2577 flags.go:64] FLAG: --enable-server="true" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992904 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992909 2577 flags.go:64] FLAG: --event-burst="100" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992912 2577 flags.go:64] FLAG: --event-qps="50" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992915 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992919 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992922 2577 flags.go:64] FLAG: --eviction-hard="" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992926 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992929 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992932 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992935 2577 flags.go:64] FLAG: --eviction-soft="" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992938 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992941 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992944 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992947 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992950 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992953 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992956 2577 flags.go:64] FLAG: --feature-gates="" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992960 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992962 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 15:02:52.995719 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992965 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992968 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992971 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992974 2577 flags.go:64] FLAG: --help="false" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992989 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-130-78.ec2.internal" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992993 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992996 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.992999 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993005 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993009 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993012 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993015 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993018 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993021 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993024 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993027 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993030 2577 flags.go:64] FLAG: --kube-reserved="" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993033 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993036 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993039 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993042 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993045 2577 flags.go:64] FLAG: --lock-file="" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993048 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993051 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 15:02:52.996346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993054 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993059 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993062 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993064 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993068 2577 flags.go:64] FLAG: --logging-format="text" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993071 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993074 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993077 2577 flags.go:64] FLAG: --manifest-url="" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993080 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993084 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993088 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993092 2577 flags.go:64] FLAG: --max-pods="110" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993095 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993098 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993102 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993105 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993112 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993116 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993119 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993127 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993130 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993133 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993136 2577 flags.go:64] FLAG: --pod-cidr="" Jun 03 15:02:52.997035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993139 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993145 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993148 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993151 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993154 2577 flags.go:64] FLAG: --port="10250" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993158 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993161 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f515e2c242d10cd9" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993164 2577 flags.go:64] FLAG: --qos-reserved="" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993167 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993170 2577 flags.go:64] FLAG: --register-node="true" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993173 2577 flags.go:64] FLAG: --register-schedulable="true" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993176 2577 flags.go:64] FLAG: --register-with-taints="" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993180 2577 flags.go:64] FLAG: --registry-burst="10" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993183 2577 flags.go:64] FLAG: --registry-qps="5" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993186 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993189 2577 flags.go:64] FLAG: --reserved-memory="" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993193 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993196 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993199 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993202 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993205 2577 flags.go:64] FLAG: --runonce="false" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993208 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993211 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993214 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993217 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993221 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 15:02:52.997607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993224 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993227 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993231 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993234 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993237 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993240 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993243 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993246 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993249 2577 flags.go:64] FLAG: --system-cgroups="" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993252 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993258 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993261 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993264 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993268 2577 flags.go:64] FLAG: --tls-min-version="" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993271 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993274 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993277 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993279 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993282 2577 flags.go:64] FLAG: --v="2" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993290 2577 flags.go:64] FLAG: --version="false" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993294 2577 flags.go:64] FLAG: --vmodule="" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993299 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.993302 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993413 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993418 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:02:52.998227 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993421 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993424 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993427 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993430 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993433 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993436 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993439 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993442 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993445 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993447 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993450 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993452 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993455 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993458 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993460 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993463 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993465 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993468 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993471 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:02:52.998844 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993474 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993477 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993479 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993482 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993485 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993487 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993490 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993495 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993499 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993502 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993505 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993508 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993510 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993513 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993516 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993519 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993521 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993524 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993526 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:02:52.999317 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993529 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993532 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993535 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993537 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993540 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993542 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993545 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993547 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993550 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993553 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993555 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993558 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993560 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993563 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993565 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993568 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993571 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993573 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993576 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993578 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:02:52.999841 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993582 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993585 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993587 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993590 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993592 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993595 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993598 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993600 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993603 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993606 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993608 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993611 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993613 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993616 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993619 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993622 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993625 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993627 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993630 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993633 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:02:53.000341 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993635 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:02:53.000988 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993639 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:02:53.000988 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993643 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:02:53.000988 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993646 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:02:53.000988 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993648 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:02:53.000988 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:52.993651 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:02:53.000988 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:52.994381 2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:02:53.002743 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.002701 2577 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 15:02:53.002838 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.002774 2577 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 15:02:53.002884 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002875 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:02:53.002884 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002882 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002885 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002889 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002892 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002895 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002899 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002903 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002907 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002910 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002912 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002915 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002918 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002921 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002924 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002927 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002929 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002932 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002934 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002937 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:02:53.002943 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002940 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002942 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002945 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002947 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002951 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002954 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002957 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002959 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002962 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002965 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002968 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002971 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002973 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002976 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002978 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002981 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002983 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002986 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002989 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002991 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:02:53.003439 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002994 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002996 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.002999 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003001 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003004 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003006 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003009 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003011 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003014 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003016 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003019 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003021 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003024 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003026 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003030 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003033 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003035 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003038 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003041 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003044 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:02:53.003940 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003047 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003050 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003052 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003055 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003057 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003060 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003063 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003065 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003068 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003070 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003073 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003075 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003078 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003080 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003084 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003088 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003090 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003093 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003096 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003098 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:02:53.004462 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003101 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:02:53.005950 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003103 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:02:53.005950 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003106 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:02:53.005950 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003109 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:02:53.005950 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003112 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:02:53.005950 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003114 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:02:53.005950 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.003120 2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:02:53.005950 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003213 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:02:53.005950 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003218 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:02:53.005950 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003221 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:02:53.005950 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003224 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:02:53.005950 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003227 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:02:53.005950 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003230 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:02:53.005950 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003233 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:02:53.005950 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003235 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:02:53.005950 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003238 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003241 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003244 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003247 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003249 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003251 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003254 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003257 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003260 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003262 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003265 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003267 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003270 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003272 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003276 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003279 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003282 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003284 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003287 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003290 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003293 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:02:53.006328 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003295 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003298 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003300 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003303 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003306 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003309 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003312 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003314 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003317 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003319 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003322 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003324 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003327 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003329 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003332 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003334 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003337 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003339 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003342 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003344 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:02:53.006858 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003347 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003349 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003352 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003356 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003359 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003375 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003380 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003384 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003387 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003390 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003393 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003396 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003398 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003401 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003405 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003407 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003410 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003413 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003415 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:02:53.007339 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003418 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:02:53.007819 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003420 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:02:53.007819 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003423 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:02:53.007819 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003426 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:02:53.007819 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003428 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:02:53.007819 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003431 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:02:53.007819 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003433 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:02:53.007819 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003436 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:02:53.007819 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003438 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:02:53.007819 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003441 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:02:53.007819 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003444 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:02:53.007819 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003446 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:02:53.007819 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003449 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:02:53.007819 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003451 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:02:53.007819 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003454 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:02:53.007819 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003457 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:02:53.007819 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003460 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:02:53.007819 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:53.003462 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:02:53.008243 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.003467 2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:02:53.008243 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.004607 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 15:02:53.008243 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.006730 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 15:02:53.008243 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.007922 2577 server.go:1019] "Starting client certificate rotation" Jun 03 15:02:53.008243 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.008019 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 15:02:53.008243 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.008054 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 15:02:53.032591 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.032573 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 15:02:53.034412 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.034395 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 15:02:53.046916 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.046895 2577 log.go:25] "Validated CRI v1 runtime API" Jun 03 15:02:53.052473 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.052454 2577 log.go:25] "Validated CRI v1 image API" Jun 03 15:02:53.056646 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.056627 2577 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 15:02:53.060838 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.060815 2577 fs.go:135] Filesystem UUIDs: map[531b5c5b-2589-4db2-8321-aff3525d73ed:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 813a4848-bcc2-40c8-90d0-2f7d1deb1b23:/dev/nvme0n1p3] Jun 03 15:02:53.060930 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.060836 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 15:02:53.066201 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.066094 2577 manager.go:217] Machine: {Timestamp:2026-06-03 15:02:53.065598913 +0000 UTC m=+0.418568931 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3059364 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f17eb596bec17e5b749fdbcd230c0 SystemUUID:ec2f17eb-596b-ec17-e5b7-49fdbcd230c0 BootID:02af326b-abbc-437c-b919-2bbffe4c8897 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4d:16:e5:a3:b9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4d:16:e5:a3:b9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:30:41:1c:b7:50 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 15:02:53.067650 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.067636 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 15:02:53.067741 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.067729 2577 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 15:02:53.069548 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.069518 2577 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 15:02:53.069682 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.069551 2577 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-78.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 15:02:53.069731 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.069692 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 15:02:53.069731 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.069700 2577 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 15:02:53.069731 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.069708 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 15:02:53.070402 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.070391 2577 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 15:02:53.072394 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.072382 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 03 15:02:53.072495 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.072486 2577 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 15:02:53.075229 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.075218 2577 kubelet.go:491] "Attempting to sync node with API server" Jun 03 15:02:53.075273 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.075231 2577 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 15:02:53.075273 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.075242 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 15:02:53.075273 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.075251 2577 kubelet.go:397] "Adding apiserver pod source" Jun 03 15:02:53.075273 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.075259 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 15:02:53.076292 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.076281 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 15:02:53.076330 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.076299 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 15:02:53.077282 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.077265 2577 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 15:02:53.080303 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.080277 2577 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 15:02:53.082716 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.082700 2577 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 15:02:53.084994 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.084971 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 15:02:53.084994 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.084998 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 15:02:53.085078 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.085004 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 15:02:53.085078 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.085010 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 15:02:53.085078 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.085018 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 15:02:53.085078 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.085024 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 15:02:53.085078 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.085029 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 15:02:53.085078 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.085034 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 15:02:53.085078 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.085042 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 15:02:53.085078 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.085048 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 15:02:53.085078 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.085057 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 15:02:53.085078 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.085062 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 15:02:53.085939 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.085930 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 15:02:53.085975 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.085940 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 15:02:53.089311 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.089298 2577 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 15:02:53.089358 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.089334 2577 server.go:1295] "Started kubelet" Jun 03 15:02:53.089496 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.089451 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 15:02:53.089641 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.089442 2577 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 15:02:53.089713 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.089655 2577 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 15:02:53.090356 ip-10-0-130-78 systemd[1]: Started Kubernetes Kubelet. Jun 03 15:02:53.090999 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.090711 2577 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 15:02:53.091333 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.091255 2577 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-78.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 15:02:53.091333 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.091258 2577 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-78.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 15:02:53.091858 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.091838 2577 server.go:317] "Adding debug handlers to kubelet server" Jun 03 15:02:53.091930 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.091890 2577 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 15:02:53.096554 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.096537 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 15:02:53.097380 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.097348 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 15:02:53.097524 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.097507 2577 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 15:02:53.097524 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.097521 2577 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 15:02:53.097654 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.097634 2577 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 15:02:53.097711 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.097683 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 03 15:02:53.097711 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.097691 2577 reconciler.go:26] "Reconciler: start to sync state" Jun 03 15:02:53.098180 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.098149 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 03 15:02:53.098994 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.098972 2577 factory.go:55] Registering systemd factory Jun 03 15:02:53.098994 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.098994 2577 factory.go:223] Registration of the systemd container factory successfully Jun 03 15:02:53.099225 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.099209 2577 factory.go:153] Registering CRI-O factory Jun 03 15:02:53.099225 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.099227 2577 factory.go:223] Registration of the crio container factory successfully Jun 03 15:02:53.099383 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.099277 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 15:02:53.099383 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.099300 2577 factory.go:103] Registering Raw factory Jun 03 15:02:53.099383 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.099317 2577 manager.go:1196] Started watching for new ooms in manager Jun 03 15:02:53.099849 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.099833 2577 manager.go:319] Starting recovery of all containers Jun 03 15:02:53.102680 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.102637 2577 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 15:02:53.104671 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.103445 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-78.ec2.internal.18b59a61edefabc5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-78.ec2.internal,UID:ip-10-0-130-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-78.ec2.internal,},FirstTimestamp:2026-06-03 15:02:53.089311685 +0000 UTC m=+0.442281701,LastTimestamp:2026-06-03 15:02:53.089311685 +0000 UTC m=+0.442281701,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-78.ec2.internal,}" Jun 03 15:02:53.104920 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.104897 2577 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 15:02:53.105240 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.105217 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-78.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 15:02:53.114378 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.114238 2577 manager.go:324] Recovery completed Jun 03 15:02:53.118340 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.118328 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:02:53.120108 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.120083 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:02:53.120172 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.120124 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:02:53.120172 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.120137 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:02:53.120656 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.120643 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 15:02:53.120656 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.120653 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 15:02:53.120743 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.120668 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 03 15:02:53.122458 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.122015 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-78.ec2.internal.18b59a61efc59815 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-78.ec2.internal,UID:ip-10-0-130-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-78.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-78.ec2.internal,},FirstTimestamp:2026-06-03 15:02:53.120108565 +0000 UTC m=+0.473078583,LastTimestamp:2026-06-03 15:02:53.120108565 +0000 UTC m=+0.473078583,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-78.ec2.internal,}" Jun 03 15:02:53.123717 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.123705 2577 policy_none.go:49] "None policy: Start" Jun 03 15:02:53.123763 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.123721 2577 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 15:02:53.123763 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.123731 2577 state_mem.go:35] "Initializing new in-memory state store" Jun 03 15:02:53.133259 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.133196 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-78.ec2.internal.18b59a61efc5f03b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-78.ec2.internal,UID:ip-10-0-130-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-78.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-78.ec2.internal,},FirstTimestamp:2026-06-03 15:02:53.120131131 +0000 UTC m=+0.473101147,LastTimestamp:2026-06-03 15:02:53.120131131 +0000 UTC m=+0.473101147,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-78.ec2.internal,}" Jun 03 15:02:53.134027 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.134011 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6h85p" Jun 03 15:02:53.143221 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.143202 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6h85p" Jun 03 15:02:53.144757 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.144678 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-78.ec2.internal.18b59a61efc6159c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-78.ec2.internal,UID:ip-10-0-130-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-78.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-78.ec2.internal,},FirstTimestamp:2026-06-03 15:02:53.1201407 +0000 UTC m=+0.473110716,LastTimestamp:2026-06-03 15:02:53.1201407 +0000 UTC m=+0.473110716,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-78.ec2.internal,}" Jun 03 15:02:53.159921 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.159906 2577 manager.go:341] "Starting Device Plugin manager" Jun 03 15:02:53.174982 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.159933 2577 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 15:02:53.174982 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.159943 2577 server.go:85] "Starting device plugin registration server" Jun 03 15:02:53.174982 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.160180 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 15:02:53.174982 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.160190 2577 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 15:02:53.174982 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.160270 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 15:02:53.174982 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.160333 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 15:02:53.174982 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.160339 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 15:02:53.174982 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.160881 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 15:02:53.174982 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.160919 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-78.ec2.internal\" not found" Jun 03 15:02:53.237199 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.237103 2577 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 15:02:53.238377 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.238348 2577 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 15:02:53.238462 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.238390 2577 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 15:02:53.238462 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.238410 2577 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 15:02:53.238462 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.238417 2577 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 15:02:53.238462 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.238460 2577 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 15:02:53.241277 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.241261 2577 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:02:53.260479 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.260453 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:02:53.261268 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.261252 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:02:53.261353 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.261286 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:02:53.261353 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.261302 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:02:53.261353 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.261330 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-78.ec2.internal" Jun 03 15:02:53.270930 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.270916 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-78.ec2.internal" Jun 03 15:02:53.270988 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.270938 2577 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-78.ec2.internal\": node \"ip-10-0-130-78.ec2.internal\" not found" Jun 03 15:02:53.313175 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.313141 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 03 15:02:53.339522 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.339489 2577 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal"] Jun 03 15:02:53.339590 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.339563 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:02:53.340481 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.340464 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:02:53.340558 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.340492 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:02:53.340558 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.340502 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:02:53.341938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.341925 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:02:53.342125 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.342111 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" Jun 03 15:02:53.342161 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.342145 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:02:53.342618 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.342604 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:02:53.342704 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.342633 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:02:53.342704 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.342649 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:02:53.342704 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.342608 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:02:53.342704 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.342701 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:02:53.342880 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.342711 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:02:53.344755 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.344736 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal" Jun 03 15:02:53.344856 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.344770 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:02:53.345440 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.345425 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:02:53.345527 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.345449 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:02:53.345527 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.345458 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:02:53.360878 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.360860 2577 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-78.ec2.internal\" not found" node="ip-10-0-130-78.ec2.internal" Jun 03 15:02:53.365861 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.365844 2577 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-78.ec2.internal\" not found" node="ip-10-0-130-78.ec2.internal" Jun 03 15:02:53.399498 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.399468 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/efe66a4ffce61cf7e3ad033cf28c3823-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal\" (UID: \"efe66a4ffce61cf7e3ad033cf28c3823\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" Jun 03 15:02:53.399608 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.399504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efe66a4ffce61cf7e3ad033cf28c3823-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal\" (UID: \"efe66a4ffce61cf7e3ad033cf28c3823\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" Jun 03 15:02:53.399608 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.399528 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9b24b2754441fa0c9003b6647a9dd2f7-config\") pod \"kube-apiserver-proxy-ip-10-0-130-78.ec2.internal\" (UID: \"9b24b2754441fa0c9003b6647a9dd2f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal" Jun 03 15:02:53.413815 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.413791 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 03 15:02:53.500540 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.500457 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/efe66a4ffce61cf7e3ad033cf28c3823-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal\" (UID: \"efe66a4ffce61cf7e3ad033cf28c3823\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" Jun 03 15:02:53.500540 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.500494 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efe66a4ffce61cf7e3ad033cf28c3823-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal\" (UID: \"efe66a4ffce61cf7e3ad033cf28c3823\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" Jun 03 15:02:53.500540 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.500520 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9b24b2754441fa0c9003b6647a9dd2f7-config\") pod \"kube-apiserver-proxy-ip-10-0-130-78.ec2.internal\" (UID: \"9b24b2754441fa0c9003b6647a9dd2f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal" Jun 03 15:02:53.500733 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.500562 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9b24b2754441fa0c9003b6647a9dd2f7-config\") pod \"kube-apiserver-proxy-ip-10-0-130-78.ec2.internal\" (UID: \"9b24b2754441fa0c9003b6647a9dd2f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal" Jun 03 15:02:53.500733 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.500562 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efe66a4ffce61cf7e3ad033cf28c3823-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal\" (UID: \"efe66a4ffce61cf7e3ad033cf28c3823\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" Jun 03 15:02:53.500733 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.500562 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/efe66a4ffce61cf7e3ad033cf28c3823-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal\" (UID: \"efe66a4ffce61cf7e3ad033cf28c3823\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" Jun 03 15:02:53.514573 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.514551 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 03 15:02:53.615297 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.615263 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 03 15:02:53.663454 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.663420 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" Jun 03 15:02:53.669054 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:53.669031 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal" Jun 03 15:02:53.716005 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.715969 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 03 15:02:53.816518 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.816443 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 03 15:02:53.916997 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:53.916946 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 03 15:02:54.007546 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:54.007519 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 15:02:54.008040 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:54.007656 2577 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 15:02:54.017671 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:54.017648 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 03 15:02:54.096678 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:54.096661 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 15:02:54.117744 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:54.117714 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 03 15:02:54.117857 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:54.117787 2577 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 15:02:54.141950 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:54.141927 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-68kz7" Jun 03 15:02:54.145041 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:54.145018 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 14:57:53 +0000 UTC" deadline="2027-11-13 13:08:06.16823661 +0000 UTC" Jun 03 15:02:54.145094 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:54.145041 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12670h5m12.023197867s" Jun 03 15:02:54.150316 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:54.150300 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-68kz7" Jun 03 15:02:54.218214 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:54.218187 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 03 15:02:54.232967 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:54.232932 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b24b2754441fa0c9003b6647a9dd2f7.slice/crio-2b6278542b55fd3c13a5aa52c314f1b5ef5cfe76678416c3feea53ba807d8d8a WatchSource:0}: Error finding container 2b6278542b55fd3c13a5aa52c314f1b5ef5cfe76678416c3feea53ba807d8d8a: Status 404 returned error can't find the container with id 2b6278542b55fd3c13a5aa52c314f1b5ef5cfe76678416c3feea53ba807d8d8a Jun 03 15:02:54.235221 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:54.235196 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe66a4ffce61cf7e3ad033cf28c3823.slice/crio-47219ce63f23f23f7fbab492a35ddce9c1d35a07dd28248440d50a3f7467c886 WatchSource:0}: Error finding container 47219ce63f23f23f7fbab492a35ddce9c1d35a07dd28248440d50a3f7467c886: Status 404 returned error can't find the container with id 47219ce63f23f23f7fbab492a35ddce9c1d35a07dd28248440d50a3f7467c886 Jun 03 15:02:54.237545 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:54.237530 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:02:54.243191 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:54.243148 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" event={"ID":"efe66a4ffce61cf7e3ad033cf28c3823","Type":"ContainerStarted","Data":"47219ce63f23f23f7fbab492a35ddce9c1d35a07dd28248440d50a3f7467c886"} Jun 03 15:02:54.244162 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:54.244143 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal" event={"ID":"9b24b2754441fa0c9003b6647a9dd2f7","Type":"ContainerStarted","Data":"2b6278542b55fd3c13a5aa52c314f1b5ef5cfe76678416c3feea53ba807d8d8a"} Jun 03 15:02:54.255689 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:54.255672 2577 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:02:54.319267 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:54.319232 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 03 15:02:54.419783 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:54.419703 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-78.ec2.internal\" not found" Jun 03 15:02:54.462503 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:54.462481 2577 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:02:54.497613 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:54.497588 2577 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" Jun 03 15:02:54.526778 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:54.526757 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 15:02:54.528396 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:54.528384 2577 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal" Jun 03 15:02:54.537042 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:54.537026 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 15:02:54.568395 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:54.568374 2577 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:02:55.076316 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.076280 2577 apiserver.go:52] "Watching apiserver" Jun 03 15:02:55.084412 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.084385 2577 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 15:02:55.084804 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.084775 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal","openshift-multus/multus-additional-cni-plugins-xm4dj","openshift-multus/multus-qbb9d","openshift-network-operator/iptables-alerter-fzzwh","kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7","openshift-dns/node-resolver-4b7cx","openshift-multus/network-metrics-daemon-klxj7","openshift-network-diagnostics/network-check-target-6wc5f","openshift-ovn-kubernetes/ovnkube-node-bfwpp","kube-system/konnectivity-agent-t8c26","openshift-cluster-node-tuning-operator/tuned-cmjlp","openshift-image-registry/node-ca-mfll7"] Jun 03 15:02:55.087458 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.087437 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4b7cx" Jun 03 15:02:55.087564 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.087501 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.089023 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.089003 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.090721 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.090703 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fzzwh" Jun 03 15:02:55.092275 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.092237 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 15:02:55.092375 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.092327 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g92qj\"" Jun 03 15:02:55.092486 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.092472 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 15:02:55.092571 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.092554 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c4hsh\"" Jun 03 15:02:55.092620 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.092562 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 15:02:55.092664 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.092651 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 15:02:55.092837 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.092821 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 15:02:55.092905 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.092821 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 15:02:55.092905 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.092875 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 15:02:55.094051 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.093701 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.094051 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.093782 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:02:55.094051 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:55.093845 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klxj7" podUID="80b3ece5-3176-4984-821a-d8817e635c90" Jun 03 15:02:55.095008 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.094989 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:02:55.095107 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:55.095055 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wc5f" podUID="0d5c6c4b-7b87-42f1-b959-938ef9c698fc" Jun 03 15:02:55.096053 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.096021 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 15:02:55.097185 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.097160 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:02:55.097566 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.097547 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bl5r5\"" Jun 03 15:02:55.098033 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.098006 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 15:02:55.098112 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.098059 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 15:02:55.098346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.098331 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 15:02:55.099626 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.098500 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m7txf\"" Jun 03 15:02:55.099626 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.098623 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 15:02:55.099626 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.098675 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gwtcb\"" Jun 03 15:02:55.099626 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.099071 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 15:02:55.099852 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.099745 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.102870 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.102849 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t8c26" Jun 03 15:02:55.103414 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.102982 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.103414 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.103383 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cs7cd\"" Jun 03 15:02:55.104130 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.104112 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 15:02:55.104220 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.104187 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 15:02:55.104331 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.104316 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 15:02:55.104505 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.104470 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mfll7" Jun 03 15:02:55.106448 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.106226 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 15:02:55.106448 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.106263 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 15:02:55.107759 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.107734 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 15:02:55.107863 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.107780 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 15:02:55.107863 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.107827 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:02:55.107863 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.107782 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7hbbw\"" Jun 03 15:02:55.108059 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.107782 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-24t6r\"" Jun 03 15:02:55.108059 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.107829 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 15:02:55.108059 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.107968 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 15:02:55.108224 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.108155 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 15:02:55.108224 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.108194 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 15:02:55.108486 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.108414 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5vrj8\"" Jun 03 15:02:55.108561 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.108540 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 15:02:55.108853 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.108827 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4387c9cf-e366-4436-80a0-0f17b01b92f0-registration-dir\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.108923 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.108866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xfwg\" (UniqueName: \"kubernetes.io/projected/4387c9cf-e366-4436-80a0-0f17b01b92f0-kube-api-access-8xfwg\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.108923 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.108895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-log-socket\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.109010 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.108923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbb6dd98-36d0-499e-99f8-422e02a621b3-env-overrides\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.109010 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.108954 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkxpk\" (UniqueName: \"kubernetes.io/projected/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-kube-api-access-mkxpk\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.109010 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.108989 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-cnibin\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.109144 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109013 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/00ed60d1-2492-44e1-864a-5028e232bb54-hosts-file\") pod \"node-resolver-4b7cx\" (UID: \"00ed60d1-2492-44e1-864a-5028e232bb54\") " pod="openshift-dns/node-resolver-4b7cx" Jun 03 15:02:55.109144 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109034 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00ed60d1-2492-44e1-864a-5028e232bb54-tmp-dir\") pod \"node-resolver-4b7cx\" (UID: \"00ed60d1-2492-44e1-864a-5028e232bb54\") " pod="openshift-dns/node-resolver-4b7cx" Jun 03 15:02:55.109144 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109058 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4387c9cf-e366-4436-80a0-0f17b01b92f0-socket-dir\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.109144 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109086 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzjjl\" (UniqueName: \"kubernetes.io/projected/80b3ece5-3176-4984-821a-d8817e635c90-kube-api-access-rzjjl\") pod \"network-metrics-daemon-klxj7\" (UID: \"80b3ece5-3176-4984-821a-d8817e635c90\") " pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:02:55.109144 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109111 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.109144 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109134 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-system-cni-dir\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.109430 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109168 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-multus-cni-dir\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.109430 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109191 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/112d4f9b-4999-4802-92a9-94d911849614-cni-binary-copy\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.109430 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109219 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-host-run-k8s-cni-cncf-io\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.109430 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109245 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4387c9cf-e366-4436-80a0-0f17b01b92f0-sys-fs\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.109430 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109272 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbb6dd98-36d0-499e-99f8-422e02a621b3-ovnkube-script-lib\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.109430 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109298 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqrjs\" (UniqueName: \"kubernetes.io/projected/fbb6dd98-36d0-499e-99f8-422e02a621b3-kube-api-access-xqrjs\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.109430 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109324 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-systemd-units\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.109430 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109349 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-os-release\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.109430 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109391 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-etc-kubernetes\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.109430 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109428 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-system-cni-dir\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.109938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109452 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-run-netns\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.109938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109485 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-multus-socket-dir-parent\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.109938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109533 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4387c9cf-e366-4436-80a0-0f17b01b92f0-device-dir\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.109938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109587 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-run-ovn\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.109938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-os-release\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.109938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109654 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-host-run-multus-certs\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.109938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109679 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc4nd\" (UniqueName: \"kubernetes.io/projected/00ed60d1-2492-44e1-864a-5028e232bb54-kube-api-access-fc4nd\") pod \"node-resolver-4b7cx\" (UID: \"00ed60d1-2492-44e1-864a-5028e232bb54\") " pod="openshift-dns/node-resolver-4b7cx" Jun 03 15:02:55.109938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109710 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-node-log\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.109938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109746 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.109938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109771 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.109938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-host-var-lib-cni-multus\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.109938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109816 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb-host-slash\") pod \"iptables-alerter-fzzwh\" (UID: \"3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb\") " pod="openshift-network-operator/iptables-alerter-fzzwh" Jun 03 15:02:55.109938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109844 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/112d4f9b-4999-4802-92a9-94d911849614-multus-daemon-config\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.109938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109865 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/405bb2f8-ad71-471c-911b-eb4b83fbeca3-agent-certs\") pod \"konnectivity-agent-t8c26\" (UID: \"405bb2f8-ad71-471c-911b-eb4b83fbeca3\") " pod="kube-system/konnectivity-agent-t8c26" Jun 03 15:02:55.109938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109891 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.109938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109918 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-host-run-netns\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.110727 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.109970 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4387c9cf-e366-4436-80a0-0f17b01b92f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.110727 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.110012 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-kubelet\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.110727 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.110706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-var-lib-openvswitch\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.110884 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.110749 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-multus-conf-dir\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.110884 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.110777 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t54v\" (UniqueName: \"kubernetes.io/projected/3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb-kube-api-access-4t54v\") pod \"iptables-alerter-fzzwh\" (UID: \"3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb\") " pod="openshift-network-operator/iptables-alerter-fzzwh" Jun 03 15:02:55.110884 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.110812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4387c9cf-e366-4436-80a0-0f17b01b92f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.110884 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.110835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-run-systemd\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.110884 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.110877 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkh42\" (UniqueName: \"kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42\") pod \"network-check-target-6wc5f\" (UID: \"0d5c6c4b-7b87-42f1-b959-938ef9c698fc\") " pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:02:55.111134 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.110961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-cni-netd\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.111134 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.110994 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.111134 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.111033 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-hostroot\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.111134 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.111057 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-slash\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.111134 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.111097 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-run-openvswitch\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.111389 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.111134 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-cni-bin\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.111389 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.111163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb-iptables-alerter-script\") pod \"iptables-alerter-fzzwh\" (UID: \"3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb\") " pod="openshift-network-operator/iptables-alerter-fzzwh" Jun 03 15:02:55.111863 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.111541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-etc-openvswitch\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.111863 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.111575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbb6dd98-36d0-499e-99f8-422e02a621b3-ovnkube-config\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.111863 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.111600 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbb6dd98-36d0-499e-99f8-422e02a621b3-ovn-node-metrics-cert\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.111863 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.111625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-host-var-lib-cni-bin\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.111863 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.111652 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p72kf\" (UniqueName: \"kubernetes.io/projected/112d4f9b-4999-4802-92a9-94d911849614-kube-api-access-p72kf\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.111863 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.111680 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs\") pod \"network-metrics-daemon-klxj7\" (UID: \"80b3ece5-3176-4984-821a-d8817e635c90\") " pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:02:55.111863 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.111703 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/405bb2f8-ad71-471c-911b-eb4b83fbeca3-konnectivity-ca\") pod \"konnectivity-agent-t8c26\" (UID: \"405bb2f8-ad71-471c-911b-eb4b83fbeca3\") " pod="kube-system/konnectivity-agent-t8c26" Jun 03 15:02:55.111863 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.111728 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-cnibin\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.111863 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.111751 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-cni-binary-copy\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.111863 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.111790 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-host-var-lib-kubelet\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.151079 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.151045 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 14:57:54 +0000 UTC" deadline="2028-02-23 00:14:42.308665546 +0000 UTC" Jun 03 15:02:55.151079 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.151079 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15105h11m47.15759121s" Jun 03 15:02:55.198450 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.198422 2577 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 15:02:55.212345 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212320 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/405bb2f8-ad71-471c-911b-eb4b83fbeca3-agent-certs\") pod \"konnectivity-agent-t8c26\" (UID: \"405bb2f8-ad71-471c-911b-eb4b83fbeca3\") " pod="kube-system/konnectivity-agent-t8c26" Jun 03 15:02:55.212487 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212354 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.212487 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212396 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-host-run-netns\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.212487 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212419 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4387c9cf-e366-4436-80a0-0f17b01b92f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.212487 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-tuned\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.212487 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212474 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c8756071-49e9-431b-86a8-d179d071de13-serviceca\") pod \"node-ca-mfll7\" (UID: \"c8756071-49e9-431b-86a8-d179d071de13\") " pod="openshift-image-registry/node-ca-mfll7" Jun 03 15:02:55.212739 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212501 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-kubelet\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.212739 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212525 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-var-lib-openvswitch\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.212739 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212544 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-multus-conf-dir\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.212739 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212562 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4t54v\" (UniqueName: \"kubernetes.io/projected/3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb-kube-api-access-4t54v\") pod \"iptables-alerter-fzzwh\" (UID: \"3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb\") " pod="openshift-network-operator/iptables-alerter-fzzwh" Jun 03 15:02:55.212739 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212585 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4387c9cf-e366-4436-80a0-0f17b01b92f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.212739 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212604 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9z6c\" (UniqueName: \"kubernetes.io/projected/c8756071-49e9-431b-86a8-d179d071de13-kube-api-access-v9z6c\") pod \"node-ca-mfll7\" (UID: \"c8756071-49e9-431b-86a8-d179d071de13\") " pod="openshift-image-registry/node-ca-mfll7" Jun 03 15:02:55.212739 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212621 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-run-systemd\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.212739 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212642 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkh42\" (UniqueName: \"kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42\") pod \"network-check-target-6wc5f\" (UID: \"0d5c6c4b-7b87-42f1-b959-938ef9c698fc\") " pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:02:55.212739 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-sysconfig\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.212739 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212692 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-host\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.212739 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212710 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-cni-netd\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.212739 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212735 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.213264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212758 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-hostroot\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.213264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212752 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 15:02:55.213264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212781 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-multus-conf-dir\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.213264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212785 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-kubernetes\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.213264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212831 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-systemd\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.213264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212853 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-run\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.213264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212875 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-slash\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.213264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212909 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-run-openvswitch\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.213264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212917 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4387c9cf-e366-4436-80a0-0f17b01b92f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.213264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212934 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-cni-bin\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.213264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212960 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb-iptables-alerter-script\") pod \"iptables-alerter-fzzwh\" (UID: \"3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb\") " pod="openshift-network-operator/iptables-alerter-fzzwh" Jun 03 15:02:55.213264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212983 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-run-systemd\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.213264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.212995 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-etc-openvswitch\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.213264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.213021 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbb6dd98-36d0-499e-99f8-422e02a621b3-ovnkube-config\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.213264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.213044 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbb6dd98-36d0-499e-99f8-422e02a621b3-ovn-node-metrics-cert\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.213264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.213091 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-host-var-lib-cni-bin\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.213264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.213163 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-run-openvswitch\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.213264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.213173 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-slash\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.214068 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.213202 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-cni-bin\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.214068 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.213231 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4387c9cf-e366-4436-80a0-0f17b01b92f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.214068 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.213298 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-kubelet\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.214068 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.213302 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-var-lib-openvswitch\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.214068 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.213339 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-cni-netd\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.214068 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.213737 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb-iptables-alerter-script\") pod \"iptables-alerter-fzzwh\" (UID: \"3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb\") " pod="openshift-network-operator/iptables-alerter-fzzwh" Jun 03 15:02:55.214068 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.213882 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p72kf\" (UniqueName: \"kubernetes.io/projected/112d4f9b-4999-4802-92a9-94d911849614-kube-api-access-p72kf\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.214068 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.213922 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs\") pod \"network-metrics-daemon-klxj7\" (UID: \"80b3ece5-3176-4984-821a-d8817e635c90\") " pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:02:55.214068 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.213948 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/405bb2f8-ad71-471c-911b-eb4b83fbeca3-konnectivity-ca\") pod \"konnectivity-agent-t8c26\" (UID: \"405bb2f8-ad71-471c-911b-eb4b83fbeca3\") " pod="kube-system/konnectivity-agent-t8c26" Jun 03 15:02:55.214068 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.213948 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.214068 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.213974 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-cnibin\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.214068 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.213997 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-host-var-lib-cni-bin\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.214068 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214001 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-cni-binary-copy\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.214674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214085 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-host-var-lib-kubelet\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.214674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214089 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-cnibin\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.214674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214119 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4387c9cf-e366-4436-80a0-0f17b01b92f0-registration-dir\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.214674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214125 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-host-var-lib-kubelet\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.214674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214146 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xfwg\" (UniqueName: \"kubernetes.io/projected/4387c9cf-e366-4436-80a0-0f17b01b92f0-kube-api-access-8xfwg\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.214674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214173 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-sys\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.214674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214199 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-log-socket\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.214674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214224 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbb6dd98-36d0-499e-99f8-422e02a621b3-env-overrides\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.214674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214255 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mkxpk\" (UniqueName: \"kubernetes.io/projected/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-kube-api-access-mkxpk\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.214674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214287 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-cnibin\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.214674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214418 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/00ed60d1-2492-44e1-864a-5028e232bb54-hosts-file\") pod \"node-resolver-4b7cx\" (UID: \"00ed60d1-2492-44e1-864a-5028e232bb54\") " pod="openshift-dns/node-resolver-4b7cx" Jun 03 15:02:55.214674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214446 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00ed60d1-2492-44e1-864a-5028e232bb54-tmp-dir\") pod \"node-resolver-4b7cx\" (UID: \"00ed60d1-2492-44e1-864a-5028e232bb54\") " pod="openshift-dns/node-resolver-4b7cx" Jun 03 15:02:55.214674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214472 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4387c9cf-e366-4436-80a0-0f17b01b92f0-socket-dir\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.214674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-lib-modules\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.214674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214513 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-cnibin\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.214674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214520 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbb6dd98-36d0-499e-99f8-422e02a621b3-ovnkube-config\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.214674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214528 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rzjjl\" (UniqueName: \"kubernetes.io/projected/80b3ece5-3176-4984-821a-d8817e635c90-kube-api-access-rzjjl\") pod \"network-metrics-daemon-klxj7\" (UID: \"80b3ece5-3176-4984-821a-d8817e635c90\") " pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:02:55.215446 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214559 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.215446 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214574 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4387c9cf-e366-4436-80a0-0f17b01b92f0-registration-dir\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.215446 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214587 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-system-cni-dir\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.215446 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214590 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/00ed60d1-2492-44e1-864a-5028e232bb54-hosts-file\") pod \"node-resolver-4b7cx\" (UID: \"00ed60d1-2492-44e1-864a-5028e232bb54\") " pod="openshift-dns/node-resolver-4b7cx" Jun 03 15:02:55.215446 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214614 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-multus-cni-dir\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.215446 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214626 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-log-socket\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.215446 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214641 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/112d4f9b-4999-4802-92a9-94d911849614-cni-binary-copy\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.215446 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214651 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-cni-binary-copy\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.215446 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214742 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-host-run-k8s-cni-cncf-io\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.215446 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214769 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4387c9cf-e366-4436-80a0-0f17b01b92f0-sys-fs\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.215446 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214796 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-var-lib-kubelet\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.215446 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214822 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbb6dd98-36d0-499e-99f8-422e02a621b3-ovnkube-script-lib\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.215446 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214846 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqrjs\" (UniqueName: \"kubernetes.io/projected/fbb6dd98-36d0-499e-99f8-422e02a621b3-kube-api-access-xqrjs\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.215446 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214851 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.215446 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214872 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-sysctl-d\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.215446 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214900 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8756071-49e9-431b-86a8-d179d071de13-host\") pod \"node-ca-mfll7\" (UID: \"c8756071-49e9-431b-86a8-d179d071de13\") " pod="openshift-image-registry/node-ca-mfll7" Jun 03 15:02:55.215446 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214910 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-hostroot\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.216230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214929 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-systemd-units\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.216230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214943 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-etc-openvswitch\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.216230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214956 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-os-release\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.216230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214978 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbb6dd98-36d0-499e-99f8-422e02a621b3-env-overrides\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.216230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214985 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-host-run-k8s-cni-cncf-io\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.216230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214984 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-etc-kubernetes\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.216230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.214739 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.216230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215072 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-etc-kubernetes\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.216230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215124 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-host-run-netns\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.216230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215156 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-sysctl-conf\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.216230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01af83d1-1161-4411-81a4-2cff6ee7e705-tmp\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.216230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215203 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/405bb2f8-ad71-471c-911b-eb4b83fbeca3-konnectivity-ca\") pod \"konnectivity-agent-t8c26\" (UID: \"405bb2f8-ad71-471c-911b-eb4b83fbeca3\") " pod="kube-system/konnectivity-agent-t8c26" Jun 03 15:02:55.216230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215279 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4387c9cf-e366-4436-80a0-0f17b01b92f0-sys-fs\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.216230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215295 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4387c9cf-e366-4436-80a0-0f17b01b92f0-socket-dir\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.216230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215207 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5lbm\" (UniqueName: \"kubernetes.io/projected/01af83d1-1161-4411-81a4-2cff6ee7e705-kube-api-access-p5lbm\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.216230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215337 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-system-cni-dir\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.216230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215385 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-run-netns\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.217047 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215416 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-multus-socket-dir-parent\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.217047 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215445 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4387c9cf-e366-4436-80a0-0f17b01b92f0-device-dir\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.217047 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215476 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-modprobe-d\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.217047 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215516 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/112d4f9b-4999-4802-92a9-94d911849614-cni-binary-copy\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.217047 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215524 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00ed60d1-2492-44e1-864a-5028e232bb54-tmp-dir\") pod \"node-resolver-4b7cx\" (UID: \"00ed60d1-2492-44e1-864a-5028e232bb54\") " pod="openshift-dns/node-resolver-4b7cx" Jun 03 15:02:55.217047 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215532 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-run-ovn\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.217047 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215560 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-os-release\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.217047 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215562 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4387c9cf-e366-4436-80a0-0f17b01b92f0-device-dir\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.217047 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215578 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-multus-socket-dir-parent\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.217047 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215587 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-host-run-multus-certs\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.217047 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215603 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-systemd-units\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.217047 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215613 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc4nd\" (UniqueName: \"kubernetes.io/projected/00ed60d1-2492-44e1-864a-5028e232bb54-kube-api-access-fc4nd\") pod \"node-resolver-4b7cx\" (UID: \"00ed60d1-2492-44e1-864a-5028e232bb54\") " pod="openshift-dns/node-resolver-4b7cx" Jun 03 15:02:55.217047 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215633 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-os-release\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.217047 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215641 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-node-log\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.217047 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215669 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.217047 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215671 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-system-cni-dir\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.217047 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215698 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.217778 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215764 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-system-cni-dir\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.217778 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215819 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-host-run-netns\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.217778 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215859 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-multus-cni-dir\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.217778 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215897 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-run-ovn\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.217778 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:55.215899 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:02:55.217778 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.215984 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbb6dd98-36d0-499e-99f8-422e02a621b3-ovnkube-script-lib\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.217778 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:55.216000 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs podName:80b3ece5-3176-4984-821a-d8817e635c90 nodeName:}" failed. No retries permitted until 2026-06-03 15:02:55.715951566 +0000 UTC m=+3.068921585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs") pod "network-metrics-daemon-klxj7" (UID: "80b3ece5-3176-4984-821a-d8817e635c90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:02:55.217778 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.216035 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-host-run-multus-certs\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.217778 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.216070 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbb6dd98-36d0-499e-99f8-422e02a621b3-node-log\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.217778 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.216124 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-os-release\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.217778 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.216137 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.217778 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.216161 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-host-var-lib-cni-multus\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.217778 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.216286 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb-host-slash\") pod \"iptables-alerter-fzzwh\" (UID: \"3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb\") " pod="openshift-network-operator/iptables-alerter-fzzwh" Jun 03 15:02:55.217778 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.216324 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/112d4f9b-4999-4802-92a9-94d911849614-multus-daemon-config\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.217778 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.216386 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/112d4f9b-4999-4802-92a9-94d911849614-host-var-lib-cni-multus\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.217778 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.216430 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb-host-slash\") pod \"iptables-alerter-fzzwh\" (UID: \"3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb\") " pod="openshift-network-operator/iptables-alerter-fzzwh" Jun 03 15:02:55.217778 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.216560 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.218383 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.216798 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbb6dd98-36d0-499e-99f8-422e02a621b3-ovn-node-metrics-cert\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.218383 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.216813 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/112d4f9b-4999-4802-92a9-94d911849614-multus-daemon-config\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.218383 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.217141 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/405bb2f8-ad71-471c-911b-eb4b83fbeca3-agent-certs\") pod \"konnectivity-agent-t8c26\" (UID: \"405bb2f8-ad71-471c-911b-eb4b83fbeca3\") " pod="kube-system/konnectivity-agent-t8c26" Jun 03 15:02:55.232158 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:55.232128 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:02:55.232158 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:55.232154 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:02:55.232313 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:55.232168 2577 projected.go:194] Error preparing data for projected volume kube-api-access-hkh42 for pod openshift-network-diagnostics/network-check-target-6wc5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:02:55.232313 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:55.232245 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42 podName:0d5c6c4b-7b87-42f1-b959-938ef9c698fc nodeName:}" failed. No retries permitted until 2026-06-03 15:02:55.732226979 +0000 UTC m=+3.085197003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hkh42" (UniqueName: "kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42") pod "network-check-target-6wc5f" (UID: "0d5c6c4b-7b87-42f1-b959-938ef9c698fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:02:55.234530 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.234507 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t54v\" (UniqueName: \"kubernetes.io/projected/3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb-kube-api-access-4t54v\") pod \"iptables-alerter-fzzwh\" (UID: \"3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb\") " pod="openshift-network-operator/iptables-alerter-fzzwh" Jun 03 15:02:55.251346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.251319 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc4nd\" (UniqueName: \"kubernetes.io/projected/00ed60d1-2492-44e1-864a-5028e232bb54-kube-api-access-fc4nd\") pod \"node-resolver-4b7cx\" (UID: \"00ed60d1-2492-44e1-864a-5028e232bb54\") " pod="openshift-dns/node-resolver-4b7cx" Jun 03 15:02:55.251637 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.251603 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p72kf\" (UniqueName: \"kubernetes.io/projected/112d4f9b-4999-4802-92a9-94d911849614-kube-api-access-p72kf\") pod \"multus-qbb9d\" (UID: \"112d4f9b-4999-4802-92a9-94d911849614\") " pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.252235 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.252178 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkxpk\" (UniqueName: \"kubernetes.io/projected/efd0c5f0-905f-486d-9f9c-f8ed997b2c9b-kube-api-access-mkxpk\") pod \"multus-additional-cni-plugins-xm4dj\" (UID: \"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b\") " pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.253114 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.253011 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzjjl\" (UniqueName: \"kubernetes.io/projected/80b3ece5-3176-4984-821a-d8817e635c90-kube-api-access-rzjjl\") pod \"network-metrics-daemon-klxj7\" (UID: \"80b3ece5-3176-4984-821a-d8817e635c90\") " pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:02:55.253422 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.253400 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqrjs\" (UniqueName: \"kubernetes.io/projected/fbb6dd98-36d0-499e-99f8-422e02a621b3-kube-api-access-xqrjs\") pod \"ovnkube-node-bfwpp\" (UID: \"fbb6dd98-36d0-499e-99f8-422e02a621b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.253664 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.253648 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xfwg\" (UniqueName: \"kubernetes.io/projected/4387c9cf-e366-4436-80a0-0f17b01b92f0-kube-api-access-8xfwg\") pod \"aws-ebs-csi-driver-node-4ffb7\" (UID: \"4387c9cf-e366-4436-80a0-0f17b01b92f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.316941 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.316900 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-sysctl-conf\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317119 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.316948 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01af83d1-1161-4411-81a4-2cff6ee7e705-tmp\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317119 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.316984 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p5lbm\" (UniqueName: \"kubernetes.io/projected/01af83d1-1161-4411-81a4-2cff6ee7e705-kube-api-access-p5lbm\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317119 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317011 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-modprobe-d\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317119 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317072 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-tuned\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317119 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317085 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-sysctl-conf\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317403 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317111 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c8756071-49e9-431b-86a8-d179d071de13-serviceca\") pod \"node-ca-mfll7\" (UID: \"c8756071-49e9-431b-86a8-d179d071de13\") " pod="openshift-image-registry/node-ca-mfll7" Jun 03 15:02:55.317403 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317142 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-modprobe-d\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317403 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317156 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v9z6c\" (UniqueName: \"kubernetes.io/projected/c8756071-49e9-431b-86a8-d179d071de13-kube-api-access-v9z6c\") pod \"node-ca-mfll7\" (UID: \"c8756071-49e9-431b-86a8-d179d071de13\") " pod="openshift-image-registry/node-ca-mfll7" Jun 03 15:02:55.317403 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317198 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-sysconfig\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317403 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317236 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-host\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317403 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317265 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-kubernetes\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317403 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317291 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-systemd\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317403 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317317 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-run\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317403 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317383 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-sys\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317876 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317392 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-sysconfig\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317876 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317412 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-lib-modules\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317876 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317468 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-var-lib-kubelet\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317876 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317496 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-sysctl-d\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317876 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317518 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8756071-49e9-431b-86a8-d179d071de13-host\") pod \"node-ca-mfll7\" (UID: \"c8756071-49e9-431b-86a8-d179d071de13\") " pod="openshift-image-registry/node-ca-mfll7" Jun 03 15:02:55.317876 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317538 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-lib-modules\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317876 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317573 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8756071-49e9-431b-86a8-d179d071de13-host\") pod \"node-ca-mfll7\" (UID: \"c8756071-49e9-431b-86a8-d179d071de13\") " pod="openshift-image-registry/node-ca-mfll7" Jun 03 15:02:55.317876 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317594 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-host\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317876 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317635 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-var-lib-kubelet\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317876 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317738 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-sysctl-d\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317876 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317754 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c8756071-49e9-431b-86a8-d179d071de13-serviceca\") pod \"node-ca-mfll7\" (UID: \"c8756071-49e9-431b-86a8-d179d071de13\") " pod="openshift-image-registry/node-ca-mfll7" Jun 03 15:02:55.317876 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317795 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-systemd\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317876 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317826 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-run\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317876 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317833 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-sys\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.317876 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.317842 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-kubernetes\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.319648 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.319627 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01af83d1-1161-4411-81a4-2cff6ee7e705-etc-tuned\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.319962 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.319934 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01af83d1-1161-4411-81a4-2cff6ee7e705-tmp\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.329917 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.329861 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5lbm\" (UniqueName: \"kubernetes.io/projected/01af83d1-1161-4411-81a4-2cff6ee7e705-kube-api-access-p5lbm\") pod \"tuned-cmjlp\" (UID: \"01af83d1-1161-4411-81a4-2cff6ee7e705\") " pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.329917 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.329885 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9z6c\" (UniqueName: \"kubernetes.io/projected/c8756071-49e9-431b-86a8-d179d071de13-kube-api-access-v9z6c\") pod \"node-ca-mfll7\" (UID: \"c8756071-49e9-431b-86a8-d179d071de13\") " pod="openshift-image-registry/node-ca-mfll7" Jun 03 15:02:55.404317 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.404274 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4b7cx" Jun 03 15:02:55.412967 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.412940 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xm4dj" Jun 03 15:02:55.421829 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.421804 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qbb9d" Jun 03 15:02:55.429448 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.429426 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fzzwh" Jun 03 15:02:55.438031 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.438009 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" Jun 03 15:02:55.449725 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.449702 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:02:55.455354 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.455336 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" Jun 03 15:02:55.461893 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.461876 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t8c26" Jun 03 15:02:55.468387 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.468356 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mfll7" Jun 03 15:02:55.563202 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.563156 2577 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:02:55.719965 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.719927 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs\") pod \"network-metrics-daemon-klxj7\" (UID: \"80b3ece5-3176-4984-821a-d8817e635c90\") " pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:02:55.720138 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:55.720082 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:02:55.720199 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:55.720153 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs podName:80b3ece5-3176-4984-821a-d8817e635c90 nodeName:}" failed. No retries permitted until 2026-06-03 15:02:56.720133035 +0000 UTC m=+4.073103063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs") pod "network-metrics-daemon-klxj7" (UID: "80b3ece5-3176-4984-821a-d8817e635c90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:02:55.820316 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:55.820274 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkh42\" (UniqueName: \"kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42\") pod \"network-check-target-6wc5f\" (UID: \"0d5c6c4b-7b87-42f1-b959-938ef9c698fc\") " pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:02:55.820484 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:55.820455 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:02:55.820484 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:55.820476 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:02:55.820484 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:55.820486 2577 projected.go:194] Error preparing data for projected volume kube-api-access-hkh42 for pod openshift-network-diagnostics/network-check-target-6wc5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:02:55.820594 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:55.820549 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42 podName:0d5c6c4b-7b87-42f1-b959-938ef9c698fc nodeName:}" failed. No retries permitted until 2026-06-03 15:02:56.820529542 +0000 UTC m=+4.173499563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hkh42" (UniqueName: "kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42") pod "network-check-target-6wc5f" (UID: "0d5c6c4b-7b87-42f1-b959-938ef9c698fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:02:55.938855 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:55.938810 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod405bb2f8_ad71_471c_911b_eb4b83fbeca3.slice/crio-fdca18d275dfb05cbf154d5c2314d86b9ea3ac2902795093f92a269c691bf0a4 WatchSource:0}: Error finding container fdca18d275dfb05cbf154d5c2314d86b9ea3ac2902795093f92a269c691bf0a4: Status 404 returned error can't find the container with id fdca18d275dfb05cbf154d5c2314d86b9ea3ac2902795093f92a269c691bf0a4 Jun 03 15:02:55.940326 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:55.940305 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod112d4f9b_4999_4802_92a9_94d911849614.slice/crio-26ba167025bc2c6237cc11308873bf9d0eba19fc63d4fd228b7734a7ed782003 WatchSource:0}: Error finding container 26ba167025bc2c6237cc11308873bf9d0eba19fc63d4fd228b7734a7ed782003: Status 404 returned error can't find the container with id 26ba167025bc2c6237cc11308873bf9d0eba19fc63d4fd228b7734a7ed782003 Jun 03 15:02:55.941029 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:55.941007 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb6dd98_36d0_499e_99f8_422e02a621b3.slice/crio-2554ba8de388a9b0a5687c976be5460c3c5b088b76e53a3851a4e7bd3707026f WatchSource:0}: Error finding container 2554ba8de388a9b0a5687c976be5460c3c5b088b76e53a3851a4e7bd3707026f: Status 404 returned error can't find the container with id 2554ba8de388a9b0a5687c976be5460c3c5b088b76e53a3851a4e7bd3707026f Jun 03 15:02:55.944749 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:55.944643 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8756071_49e9_431b_86a8_d179d071de13.slice/crio-7bb586dad4c6566d14238debbc075e765164c2b3cb5d17d063b8f68b7ef8a0f9 WatchSource:0}: Error finding container 7bb586dad4c6566d14238debbc075e765164c2b3cb5d17d063b8f68b7ef8a0f9: Status 404 returned error can't find the container with id 7bb586dad4c6566d14238debbc075e765164c2b3cb5d17d063b8f68b7ef8a0f9 Jun 03 15:02:55.945653 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:55.945629 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4387c9cf_e366_4436_80a0_0f17b01b92f0.slice/crio-3a7f0192e5c7a4d2adb19dfbf7af35d72d322f38c83f56bddde19aa429af3c7e WatchSource:0}: Error finding container 3a7f0192e5c7a4d2adb19dfbf7af35d72d322f38c83f56bddde19aa429af3c7e: Status 404 returned error can't find the container with id 3a7f0192e5c7a4d2adb19dfbf7af35d72d322f38c83f56bddde19aa429af3c7e Jun 03 15:02:55.946987 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:55.946960 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01af83d1_1161_4411_81a4_2cff6ee7e705.slice/crio-999cf1f48de79461075972f7aa82e2ab3f298146d85bfc6534cb1f18031f453d WatchSource:0}: Error finding container 999cf1f48de79461075972f7aa82e2ab3f298146d85bfc6534cb1f18031f453d: Status 404 returned error can't find the container with id 999cf1f48de79461075972f7aa82e2ab3f298146d85bfc6534cb1f18031f453d Jun 03 15:02:55.948452 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:55.948267 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ed60d1_2492_44e1_864a_5028e232bb54.slice/crio-135cd225fbca1415edce97f865af546575133aabb4ddbc232535f7cc029a5911 WatchSource:0}: Error finding container 135cd225fbca1415edce97f865af546575133aabb4ddbc232535f7cc029a5911: Status 404 returned error can't find the container with id 135cd225fbca1415edce97f865af546575133aabb4ddbc232535f7cc029a5911 Jun 03 15:02:55.949553 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:55.949517 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefd0c5f0_905f_486d_9f9c_f8ed997b2c9b.slice/crio-9e4fe8ca1da9c3f241c798e14f4df5c27b5e35f942d59a9ab86bacab7295fa6a WatchSource:0}: Error finding container 9e4fe8ca1da9c3f241c798e14f4df5c27b5e35f942d59a9ab86bacab7295fa6a: Status 404 returned error can't find the container with id 9e4fe8ca1da9c3f241c798e14f4df5c27b5e35f942d59a9ab86bacab7295fa6a Jun 03 15:02:55.950489 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:02:55.950424 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eceaa0c_23ae_4b47_87b5_0f87ca0f25cb.slice/crio-dad90f401517c23a3c42abee4fc2e5219090734f0b11da5336b1b090fe4cf3ef WatchSource:0}: Error finding container dad90f401517c23a3c42abee4fc2e5219090734f0b11da5336b1b090fe4cf3ef: Status 404 returned error can't find the container with id dad90f401517c23a3c42abee4fc2e5219090734f0b11da5336b1b090fe4cf3ef Jun 03 15:02:56.151690 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:56.151502 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 14:57:54 +0000 UTC" deadline="2027-12-20 18:34:28.837999119 +0000 UTC" Jun 03 15:02:56.151690 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:56.151689 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13563h31m32.686314635s" Jun 03 15:02:56.238844 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:56.238824 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:02:56.238959 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:56.238937 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wc5f" podUID="0d5c6c4b-7b87-42f1-b959-938ef9c698fc" Jun 03 15:02:56.248380 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:56.248345 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal" event={"ID":"9b24b2754441fa0c9003b6647a9dd2f7","Type":"ContainerStarted","Data":"8d519512e508bc7e5aa7e9fcfd216dac63b5e46db3074af65c92460e3cd04553"} Jun 03 15:02:56.249396 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:56.249359 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fzzwh" event={"ID":"3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb","Type":"ContainerStarted","Data":"dad90f401517c23a3c42abee4fc2e5219090734f0b11da5336b1b090fe4cf3ef"} Jun 03 15:02:56.250226 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:56.250205 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" event={"ID":"01af83d1-1161-4411-81a4-2cff6ee7e705","Type":"ContainerStarted","Data":"999cf1f48de79461075972f7aa82e2ab3f298146d85bfc6534cb1f18031f453d"} Jun 03 15:02:56.251052 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:56.251032 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" event={"ID":"fbb6dd98-36d0-499e-99f8-422e02a621b3","Type":"ContainerStarted","Data":"2554ba8de388a9b0a5687c976be5460c3c5b088b76e53a3851a4e7bd3707026f"} Jun 03 15:02:56.252082 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:56.252051 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t8c26" event={"ID":"405bb2f8-ad71-471c-911b-eb4b83fbeca3","Type":"ContainerStarted","Data":"fdca18d275dfb05cbf154d5c2314d86b9ea3ac2902795093f92a269c691bf0a4"} Jun 03 15:02:56.253378 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:56.253349 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" event={"ID":"efe66a4ffce61cf7e3ad033cf28c3823","Type":"ContainerStarted","Data":"a6f7e342705da0145b4934966381b7c8d53cbbfa973fd58058c470c58e6c9bd6"} Jun 03 15:02:56.254257 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:56.254238 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xm4dj" event={"ID":"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b","Type":"ContainerStarted","Data":"9e4fe8ca1da9c3f241c798e14f4df5c27b5e35f942d59a9ab86bacab7295fa6a"} Jun 03 15:02:56.255162 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:56.255130 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4b7cx" event={"ID":"00ed60d1-2492-44e1-864a-5028e232bb54","Type":"ContainerStarted","Data":"135cd225fbca1415edce97f865af546575133aabb4ddbc232535f7cc029a5911"} Jun 03 15:02:56.256021 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:56.256004 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" event={"ID":"4387c9cf-e366-4436-80a0-0f17b01b92f0","Type":"ContainerStarted","Data":"3a7f0192e5c7a4d2adb19dfbf7af35d72d322f38c83f56bddde19aa429af3c7e"} Jun 03 15:02:56.256857 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:56.256838 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mfll7" event={"ID":"c8756071-49e9-431b-86a8-d179d071de13","Type":"ContainerStarted","Data":"7bb586dad4c6566d14238debbc075e765164c2b3cb5d17d063b8f68b7ef8a0f9"} Jun 03 15:02:56.257723 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:56.257705 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qbb9d" event={"ID":"112d4f9b-4999-4802-92a9-94d911849614","Type":"ContainerStarted","Data":"26ba167025bc2c6237cc11308873bf9d0eba19fc63d4fd228b7734a7ed782003"} Jun 03 15:02:56.296686 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:56.296644 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-78.ec2.internal" podStartSLOduration=2.296632126 podStartE2EDuration="2.296632126s" podCreationTimestamp="2026-06-03 15:02:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:02:56.272728099 +0000 UTC m=+3.625698124" watchObservedRunningTime="2026-06-03 15:02:56.296632126 +0000 UTC m=+3.649602152" Jun 03 15:02:56.730228 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:56.729606 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs\") pod \"network-metrics-daemon-klxj7\" (UID: \"80b3ece5-3176-4984-821a-d8817e635c90\") " pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:02:56.730228 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:56.729786 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:02:56.730228 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:56.729850 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs podName:80b3ece5-3176-4984-821a-d8817e635c90 nodeName:}" failed. No retries permitted until 2026-06-03 15:02:58.7298302 +0000 UTC m=+6.082800221 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs") pod "network-metrics-daemon-klxj7" (UID: "80b3ece5-3176-4984-821a-d8817e635c90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:02:56.830654 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:56.830615 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkh42\" (UniqueName: \"kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42\") pod \"network-check-target-6wc5f\" (UID: \"0d5c6c4b-7b87-42f1-b959-938ef9c698fc\") " pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:02:56.830852 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:56.830825 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:02:56.830852 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:56.830848 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:02:56.831015 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:56.830861 2577 projected.go:194] Error preparing data for projected volume kube-api-access-hkh42 for pod openshift-network-diagnostics/network-check-target-6wc5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:02:56.831015 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:56.830920 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42 podName:0d5c6c4b-7b87-42f1-b959-938ef9c698fc nodeName:}" failed. No retries permitted until 2026-06-03 15:02:58.830900731 +0000 UTC m=+6.183870747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hkh42" (UniqueName: "kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42") pod "network-check-target-6wc5f" (UID: "0d5c6c4b-7b87-42f1-b959-938ef9c698fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:02:57.241649 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:57.241075 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:02:57.241649 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:57.241242 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klxj7" podUID="80b3ece5-3176-4984-821a-d8817e635c90" Jun 03 15:02:57.273986 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:57.273951 2577 generic.go:358] "Generic (PLEG): container finished" podID="efe66a4ffce61cf7e3ad033cf28c3823" containerID="a6f7e342705da0145b4934966381b7c8d53cbbfa973fd58058c470c58e6c9bd6" exitCode=0 Jun 03 15:02:57.274897 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:57.274865 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" event={"ID":"efe66a4ffce61cf7e3ad033cf28c3823","Type":"ContainerDied","Data":"a6f7e342705da0145b4934966381b7c8d53cbbfa973fd58058c470c58e6c9bd6"} Jun 03 15:02:58.239490 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:58.239456 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:02:58.239658 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:58.239594 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wc5f" podUID="0d5c6c4b-7b87-42f1-b959-938ef9c698fc" Jun 03 15:02:58.290034 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:58.289996 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" event={"ID":"efe66a4ffce61cf7e3ad033cf28c3823","Type":"ContainerStarted","Data":"508279ad2758fcb1dfad8dcb7d844fb87fc14e660ebcb8249a8a4e183bfa2bac"} Jun 03 15:02:58.315453 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:58.315393 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-78.ec2.internal" podStartSLOduration=4.315374669 podStartE2EDuration="4.315374669s" podCreationTimestamp="2026-06-03 15:02:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:02:58.314709148 +0000 UTC m=+5.667679176" watchObservedRunningTime="2026-06-03 15:02:58.315374669 +0000 UTC m=+5.668344692" Jun 03 15:02:58.748810 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:58.748772 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs\") pod \"network-metrics-daemon-klxj7\" (UID: \"80b3ece5-3176-4984-821a-d8817e635c90\") " pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:02:58.748982 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:58.748933 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:02:58.749038 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:58.749016 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs podName:80b3ece5-3176-4984-821a-d8817e635c90 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:02.748986208 +0000 UTC m=+10.101956231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs") pod "network-metrics-daemon-klxj7" (UID: "80b3ece5-3176-4984-821a-d8817e635c90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:02:58.849697 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:58.849659 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkh42\" (UniqueName: \"kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42\") pod \"network-check-target-6wc5f\" (UID: \"0d5c6c4b-7b87-42f1-b959-938ef9c698fc\") " pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:02:58.849875 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:58.849809 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:02:58.849875 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:58.849829 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:02:58.849875 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:58.849841 2577 projected.go:194] Error preparing data for projected volume kube-api-access-hkh42 for pod openshift-network-diagnostics/network-check-target-6wc5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:02:58.850020 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:58.849895 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42 podName:0d5c6c4b-7b87-42f1-b959-938ef9c698fc nodeName:}" failed. No retries permitted until 2026-06-03 15:03:02.849876217 +0000 UTC m=+10.202846238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hkh42" (UniqueName: "kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42") pod "network-check-target-6wc5f" (UID: "0d5c6c4b-7b87-42f1-b959-938ef9c698fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:02:59.239322 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:02:59.239260 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:02:59.239521 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:02:59.239425 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klxj7" podUID="80b3ece5-3176-4984-821a-d8817e635c90" Jun 03 15:03:00.239300 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:00.239261 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:00.239747 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:00.239424 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wc5f" podUID="0d5c6c4b-7b87-42f1-b959-938ef9c698fc" Jun 03 15:03:01.239069 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:01.239009 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:01.239251 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:01.239142 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klxj7" podUID="80b3ece5-3176-4984-821a-d8817e635c90" Jun 03 15:03:02.239015 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:02.238982 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:02.239473 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:02.239098 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wc5f" podUID="0d5c6c4b-7b87-42f1-b959-938ef9c698fc" Jun 03 15:03:02.782509 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:02.782436 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs\") pod \"network-metrics-daemon-klxj7\" (UID: \"80b3ece5-3176-4984-821a-d8817e635c90\") " pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:02.782688 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:02.782606 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:02.782688 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:02.782686 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs podName:80b3ece5-3176-4984-821a-d8817e635c90 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:10.782665073 +0000 UTC m=+18.135635092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs") pod "network-metrics-daemon-klxj7" (UID: "80b3ece5-3176-4984-821a-d8817e635c90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:02.883640 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:02.882981 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkh42\" (UniqueName: \"kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42\") pod \"network-check-target-6wc5f\" (UID: \"0d5c6c4b-7b87-42f1-b959-938ef9c698fc\") " pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:02.883640 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:02.883187 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:03:02.883640 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:02.883206 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:03:02.883640 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:02.883219 2577 projected.go:194] Error preparing data for projected volume kube-api-access-hkh42 for pod openshift-network-diagnostics/network-check-target-6wc5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:02.883640 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:02.883278 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42 podName:0d5c6c4b-7b87-42f1-b959-938ef9c698fc nodeName:}" failed. No retries permitted until 2026-06-03 15:03:10.883257984 +0000 UTC m=+18.236228001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hkh42" (UniqueName: "kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42") pod "network-check-target-6wc5f" (UID: "0d5c6c4b-7b87-42f1-b959-938ef9c698fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:03.240513 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:03.240481 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:03.240959 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:03.240605 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klxj7" podUID="80b3ece5-3176-4984-821a-d8817e635c90" Jun 03 15:03:04.239390 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:04.239235 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:04.239572 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:04.239387 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wc5f" podUID="0d5c6c4b-7b87-42f1-b959-938ef9c698fc" Jun 03 15:03:05.239971 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:05.239510 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:05.239971 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:05.239652 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klxj7" podUID="80b3ece5-3176-4984-821a-d8817e635c90" Jun 03 15:03:06.238816 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:06.238734 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:06.238970 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:06.238842 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wc5f" podUID="0d5c6c4b-7b87-42f1-b959-938ef9c698fc" Jun 03 15:03:07.238952 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:07.238918 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:07.239429 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:07.239059 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klxj7" podUID="80b3ece5-3176-4984-821a-d8817e635c90" Jun 03 15:03:08.239273 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:08.239238 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:08.239728 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:08.239339 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wc5f" podUID="0d5c6c4b-7b87-42f1-b959-938ef9c698fc" Jun 03 15:03:09.239345 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:09.239316 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:09.239742 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:09.239454 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klxj7" podUID="80b3ece5-3176-4984-821a-d8817e635c90" Jun 03 15:03:10.239523 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:10.239486 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:10.239965 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:10.239608 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wc5f" podUID="0d5c6c4b-7b87-42f1-b959-938ef9c698fc" Jun 03 15:03:10.842099 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:10.842058 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs\") pod \"network-metrics-daemon-klxj7\" (UID: \"80b3ece5-3176-4984-821a-d8817e635c90\") " pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:10.842337 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:10.842201 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:10.842337 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:10.842271 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs podName:80b3ece5-3176-4984-821a-d8817e635c90 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:26.842251299 +0000 UTC m=+34.195221315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs") pod "network-metrics-daemon-klxj7" (UID: "80b3ece5-3176-4984-821a-d8817e635c90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:10.942617 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:10.942584 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkh42\" (UniqueName: \"kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42\") pod \"network-check-target-6wc5f\" (UID: \"0d5c6c4b-7b87-42f1-b959-938ef9c698fc\") " pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:10.942786 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:10.942765 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:03:10.942845 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:10.942793 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:03:10.942845 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:10.942807 2577 projected.go:194] Error preparing data for projected volume kube-api-access-hkh42 for pod openshift-network-diagnostics/network-check-target-6wc5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:10.942904 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:10.942868 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42 podName:0d5c6c4b-7b87-42f1-b959-938ef9c698fc nodeName:}" failed. No retries permitted until 2026-06-03 15:03:26.942849726 +0000 UTC m=+34.295819736 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hkh42" (UniqueName: "kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42") pod "network-check-target-6wc5f" (UID: "0d5c6c4b-7b87-42f1-b959-938ef9c698fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:11.239551 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:11.239521 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:11.239971 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:11.239660 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klxj7" podUID="80b3ece5-3176-4984-821a-d8817e635c90" Jun 03 15:03:12.239243 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:12.239210 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:12.239445 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:12.239315 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wc5f" podUID="0d5c6c4b-7b87-42f1-b959-938ef9c698fc" Jun 03 15:03:13.240259 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:13.240226 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:13.240617 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:13.240353 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klxj7" podUID="80b3ece5-3176-4984-821a-d8817e635c90" Jun 03 15:03:14.239517 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.239333 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:14.239665 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:14.239640 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wc5f" podUID="0d5c6c4b-7b87-42f1-b959-938ef9c698fc" Jun 03 15:03:14.327755 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.327729 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mfll7" event={"ID":"c8756071-49e9-431b-86a8-d179d071de13","Type":"ContainerStarted","Data":"ec6d4fcab2f2f7098f03f0cb53d17374f50b9fcf61eaf3b72e1605ebedb815b6"} Jun 03 15:03:14.329264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.329239 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qbb9d" event={"ID":"112d4f9b-4999-4802-92a9-94d911849614","Type":"ContainerStarted","Data":"5b5c7cd83b74a41845f56917ea532e1b40aad68863a0a77fc743e186cdbea6b7"} Jun 03 15:03:14.330537 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.330516 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" event={"ID":"01af83d1-1161-4411-81a4-2cff6ee7e705","Type":"ContainerStarted","Data":"50ec5f40327c98b013d27821bef3ea17fd28bd74d8c06cafe7109c024381be6b"} Jun 03 15:03:14.332675 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.332658 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfwpp_fbb6dd98-36d0-499e-99f8-422e02a621b3/ovn-acl-logging/0.log" Jun 03 15:03:14.335615 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.335593 2577 generic.go:358] "Generic (PLEG): container finished" podID="fbb6dd98-36d0-499e-99f8-422e02a621b3" containerID="aeaaf742bdd80b16ca740f88203b62c401d3881989b4a37cb43ff3f66cc148f9" exitCode=1 Jun 03 15:03:14.335692 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.335653 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" event={"ID":"fbb6dd98-36d0-499e-99f8-422e02a621b3","Type":"ContainerStarted","Data":"91d5731c8f684798f0d82775634be787d323669f2febfd9a4349221c1cbeaeac"} Jun 03 15:03:14.335692 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.335671 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" event={"ID":"fbb6dd98-36d0-499e-99f8-422e02a621b3","Type":"ContainerStarted","Data":"4466358894c310da34ebc6f4a52b57bdad0af3fb0a88886aa625e864a3a15364"} Jun 03 15:03:14.335692 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.335680 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" event={"ID":"fbb6dd98-36d0-499e-99f8-422e02a621b3","Type":"ContainerStarted","Data":"46b111a1ceb7f1fc5dfaa9fc6752ddddae4145609d36425fd577082abb12d0fe"} Jun 03 15:03:14.335692 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.335689 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" event={"ID":"fbb6dd98-36d0-499e-99f8-422e02a621b3","Type":"ContainerDied","Data":"aeaaf742bdd80b16ca740f88203b62c401d3881989b4a37cb43ff3f66cc148f9"} Jun 03 15:03:14.335808 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.335698 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" event={"ID":"fbb6dd98-36d0-499e-99f8-422e02a621b3","Type":"ContainerStarted","Data":"2964857cf25ea65e256794e59353f5e0b1bd069da49db913996374e540acb335"} Jun 03 15:03:14.336861 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.336831 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t8c26" event={"ID":"405bb2f8-ad71-471c-911b-eb4b83fbeca3","Type":"ContainerStarted","Data":"c99d58d19e61f81d216915e5b498c2fc36c6ebb9d3cfa241ae7fd7b25946add1"} Jun 03 15:03:14.338028 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.338009 2577 generic.go:358] "Generic (PLEG): container finished" podID="efd0c5f0-905f-486d-9f9c-f8ed997b2c9b" containerID="4ae85ffcf3c88d7551c865461a43a8ab26987a6c94fbaf2ca0338fde15939763" exitCode=0 Jun 03 15:03:14.338116 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.338071 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xm4dj" event={"ID":"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b","Type":"ContainerDied","Data":"4ae85ffcf3c88d7551c865461a43a8ab26987a6c94fbaf2ca0338fde15939763"} Jun 03 15:03:14.339331 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.339283 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4b7cx" event={"ID":"00ed60d1-2492-44e1-864a-5028e232bb54","Type":"ContainerStarted","Data":"c3a1ca775b8c9f2f5e85bf2fedfb6cd10a25fdc01811917d037f12083b3a9d9e"} Jun 03 15:03:14.340838 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.340541 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" event={"ID":"4387c9cf-e366-4436-80a0-0f17b01b92f0","Type":"ContainerStarted","Data":"2dbb50e6f72aa2cd83fdff8e15b7f444dc9d4fd87478f6a049ad30e0744cd5e0"} Jun 03 15:03:14.383991 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.383955 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mfll7" podStartSLOduration=3.656891946 podStartE2EDuration="21.383942647s" podCreationTimestamp="2026-06-03 15:02:53 +0000 UTC" firstStartedPulling="2026-06-03 15:02:55.946559917 +0000 UTC m=+3.299529922" lastFinishedPulling="2026-06-03 15:03:13.673610616 +0000 UTC m=+21.026580623" observedRunningTime="2026-06-03 15:03:14.359407789 +0000 UTC m=+21.712377814" watchObservedRunningTime="2026-06-03 15:03:14.383942647 +0000 UTC m=+21.736912704" Jun 03 15:03:14.454470 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.454411 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-4b7cx" podStartSLOduration=3.779168909 podStartE2EDuration="21.454397087s" podCreationTimestamp="2026-06-03 15:02:53 +0000 UTC" firstStartedPulling="2026-06-03 15:02:55.951820019 +0000 UTC m=+3.304790028" lastFinishedPulling="2026-06-03 15:03:13.627048203 +0000 UTC m=+20.980018206" observedRunningTime="2026-06-03 15:03:14.384655894 +0000 UTC m=+21.737625911" watchObservedRunningTime="2026-06-03 15:03:14.454397087 +0000 UTC m=+21.807367114" Jun 03 15:03:14.483072 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.483022 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t8c26" podStartSLOduration=8.236366451 podStartE2EDuration="21.483011388s" podCreationTimestamp="2026-06-03 15:02:53 +0000 UTC" firstStartedPulling="2026-06-03 15:02:55.941267253 +0000 UTC m=+3.294237270" lastFinishedPulling="2026-06-03 15:03:09.187912198 +0000 UTC m=+16.540882207" observedRunningTime="2026-06-03 15:03:14.482099155 +0000 UTC m=+21.835069183" watchObservedRunningTime="2026-06-03 15:03:14.483011388 +0000 UTC m=+21.835981415" Jun 03 15:03:14.508509 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.508466 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cmjlp" podStartSLOduration=3.753068693 podStartE2EDuration="21.508454859s" podCreationTimestamp="2026-06-03 15:02:53 +0000 UTC" firstStartedPulling="2026-06-03 15:02:55.949735865 +0000 UTC m=+3.302705885" lastFinishedPulling="2026-06-03 15:03:13.705122032 +0000 UTC m=+21.058092051" observedRunningTime="2026-06-03 15:03:14.508119366 +0000 UTC m=+21.861089391" watchObservedRunningTime="2026-06-03 15:03:14.508454859 +0000 UTC m=+21.861424884" Jun 03 15:03:14.531788 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:14.531723 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-qbb9d" podStartSLOduration=3.408616708 podStartE2EDuration="21.53171244s" podCreationTimestamp="2026-06-03 15:02:53 +0000 UTC" firstStartedPulling="2026-06-03 15:02:55.942935438 +0000 UTC m=+3.295905456" lastFinishedPulling="2026-06-03 15:03:14.066031183 +0000 UTC m=+21.419001188" observedRunningTime="2026-06-03 15:03:14.531171687 +0000 UTC m=+21.884141713" watchObservedRunningTime="2026-06-03 15:03:14.53171244 +0000 UTC m=+21.884682466" Jun 03 15:03:15.239537 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:15.239509 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:15.239733 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:15.239635 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klxj7" podUID="80b3ece5-3176-4984-821a-d8817e635c90" Jun 03 15:03:15.347160 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:15.347135 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfwpp_fbb6dd98-36d0-499e-99f8-422e02a621b3/ovn-acl-logging/0.log" Jun 03 15:03:15.347646 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:15.347616 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" event={"ID":"fbb6dd98-36d0-499e-99f8-422e02a621b3","Type":"ContainerStarted","Data":"5979dc63a7e512f7d66a4459352946ad837a5a2eacea94ce3e1416e6b3c44733"} Jun 03 15:03:15.349281 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:15.349194 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fzzwh" event={"ID":"3eceaa0c-23ae-4b47-87b5-0f87ca0f25cb","Type":"ContainerStarted","Data":"5e3dbea26916476160f905c6871aa2f9ab668dbc6cddbf5f6860b6180a8d28d4"} Jun 03 15:03:15.380441 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:15.380394 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fzzwh" podStartSLOduration=4.627653097 podStartE2EDuration="22.380379387s" podCreationTimestamp="2026-06-03 15:02:53 +0000 UTC" firstStartedPulling="2026-06-03 15:02:55.952795155 +0000 UTC m=+3.305765166" lastFinishedPulling="2026-06-03 15:03:13.705521451 +0000 UTC m=+21.058491456" observedRunningTime="2026-06-03 15:03:15.380344336 +0000 UTC m=+22.733314363" watchObservedRunningTime="2026-06-03 15:03:15.380379387 +0000 UTC m=+22.733349404" Jun 03 15:03:15.397945 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:15.397876 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 15:03:16.171172 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:16.170970 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T15:03:15.397899471Z","UUID":"5af15945-99e1-4204-ab5f-245abc8c0bd0","Handler":null,"Name":"","Endpoint":""} Jun 03 15:03:16.173717 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:16.173688 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 15:03:16.173717 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:16.173723 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 15:03:16.239155 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:16.239072 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:16.239305 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:16.239193 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wc5f" podUID="0d5c6c4b-7b87-42f1-b959-938ef9c698fc" Jun 03 15:03:16.352877 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:16.352837 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" event={"ID":"4387c9cf-e366-4436-80a0-0f17b01b92f0","Type":"ContainerStarted","Data":"18220bbea52fba8f8fdb2e3300383fb585ce93efac4e89c704856084795be264"} Jun 03 15:03:17.239572 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:17.239312 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:17.239736 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:17.239690 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klxj7" podUID="80b3ece5-3176-4984-821a-d8817e635c90" Jun 03 15:03:17.356697 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:17.356663 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" event={"ID":"4387c9cf-e366-4436-80a0-0f17b01b92f0","Type":"ContainerStarted","Data":"cc8225e9c787dd7cafaed3875496ccd23058a7214579136a2f3e8ddbc381a46b"} Jun 03 15:03:17.360675 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:17.360649 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfwpp_fbb6dd98-36d0-499e-99f8-422e02a621b3/ovn-acl-logging/0.log" Jun 03 15:03:17.361141 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:17.361081 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" event={"ID":"fbb6dd98-36d0-499e-99f8-422e02a621b3","Type":"ContainerStarted","Data":"8565c3d8ea6ab97776babdcffcbed2fb7d28a2f89887103c09949b9bac764a37"} Jun 03 15:03:17.382300 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:17.382252 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4ffb7" podStartSLOduration=3.918000998 podStartE2EDuration="24.382239619s" podCreationTimestamp="2026-06-03 15:02:53 +0000 UTC" firstStartedPulling="2026-06-03 15:02:55.94798218 +0000 UTC m=+3.300952197" lastFinishedPulling="2026-06-03 15:03:16.41222081 +0000 UTC m=+23.765190818" observedRunningTime="2026-06-03 15:03:17.381730598 +0000 UTC m=+24.734700636" watchObservedRunningTime="2026-06-03 15:03:17.382239619 +0000 UTC m=+24.735209642" Jun 03 15:03:18.239319 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:18.239286 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:18.239532 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:18.239427 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wc5f" podUID="0d5c6c4b-7b87-42f1-b959-938ef9c698fc" Jun 03 15:03:18.252148 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:18.252123 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t8c26" Jun 03 15:03:18.252768 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:18.252741 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t8c26" Jun 03 15:03:18.363588 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:18.363548 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t8c26" Jun 03 15:03:18.364113 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:18.363937 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t8c26" Jun 03 15:03:19.238727 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:19.238680 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:19.238892 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:19.238812 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klxj7" podUID="80b3ece5-3176-4984-821a-d8817e635c90" Jun 03 15:03:20.239593 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:20.239410 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:20.240300 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:20.239667 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wc5f" podUID="0d5c6c4b-7b87-42f1-b959-938ef9c698fc" Jun 03 15:03:20.370553 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:20.370519 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfwpp_fbb6dd98-36d0-499e-99f8-422e02a621b3/ovn-acl-logging/0.log" Jun 03 15:03:20.370871 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:20.370845 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" event={"ID":"fbb6dd98-36d0-499e-99f8-422e02a621b3","Type":"ContainerStarted","Data":"3a9f7ea28c7d5b4626c868c0553e370db00138d08b2eada18bc910b4914d2258"} Jun 03 15:03:20.371240 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:20.371213 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:03:20.371340 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:20.371311 2577 scope.go:117] "RemoveContainer" containerID="aeaaf742bdd80b16ca740f88203b62c401d3881989b4a37cb43ff3f66cc148f9" Jun 03 15:03:20.372488 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:20.372467 2577 generic.go:358] "Generic (PLEG): container finished" podID="efd0c5f0-905f-486d-9f9c-f8ed997b2c9b" containerID="0138244d7a0ee86c2118e4d6be03f7dd542c5d30f3e50fc0cb163c0e8d090d44" exitCode=0 Jun 03 15:03:20.372584 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:20.372533 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xm4dj" event={"ID":"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b","Type":"ContainerDied","Data":"0138244d7a0ee86c2118e4d6be03f7dd542c5d30f3e50fc0cb163c0e8d090d44"} Jun 03 15:03:20.389012 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:20.388992 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:03:21.239542 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:21.239517 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:21.239650 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:21.239634 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klxj7" podUID="80b3ece5-3176-4984-821a-d8817e635c90" Jun 03 15:03:21.314929 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:21.314897 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6wc5f"] Jun 03 15:03:21.315070 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:21.315023 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:21.315153 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:21.315133 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wc5f" podUID="0d5c6c4b-7b87-42f1-b959-938ef9c698fc" Jun 03 15:03:21.315502 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:21.315477 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-klxj7"] Jun 03 15:03:21.376503 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:21.376468 2577 generic.go:358] "Generic (PLEG): container finished" podID="efd0c5f0-905f-486d-9f9c-f8ed997b2c9b" containerID="3a2831137859b330821a66ce8926ff7b37361e651cc386c1326b83f61a655146" exitCode=0 Jun 03 15:03:21.376649 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:21.376558 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xm4dj" event={"ID":"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b","Type":"ContainerDied","Data":"3a2831137859b330821a66ce8926ff7b37361e651cc386c1326b83f61a655146"} Jun 03 15:03:21.379786 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:21.379770 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfwpp_fbb6dd98-36d0-499e-99f8-422e02a621b3/ovn-acl-logging/0.log" Jun 03 15:03:21.380111 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:21.380092 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:21.380216 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:21.380118 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" event={"ID":"fbb6dd98-36d0-499e-99f8-422e02a621b3","Type":"ContainerStarted","Data":"a1f3164ccbc6362a63689d2be8969b3eaaec923a2e1bea9afe71a0c4ec8cc95b"} Jun 03 15:03:21.380281 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:21.380207 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klxj7" podUID="80b3ece5-3176-4984-821a-d8817e635c90" Jun 03 15:03:21.380493 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:21.380476 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:03:21.380493 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:21.380497 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:03:21.395482 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:21.395431 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:03:22.383410 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:22.383384 2577 generic.go:358] "Generic (PLEG): container finished" podID="efd0c5f0-905f-486d-9f9c-f8ed997b2c9b" containerID="d0432ed96fbc2fc0dda15e8b815baa3a0437c0966617a9a1dfeb2325b96dcb8c" exitCode=0 Jun 03 15:03:22.383689 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:22.383477 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xm4dj" event={"ID":"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b","Type":"ContainerDied","Data":"d0432ed96fbc2fc0dda15e8b815baa3a0437c0966617a9a1dfeb2325b96dcb8c"} Jun 03 15:03:22.428166 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:22.428122 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" podStartSLOduration=11.623455279 podStartE2EDuration="29.428108329s" podCreationTimestamp="2026-06-03 15:02:53 +0000 UTC" firstStartedPulling="2026-06-03 15:02:55.943495927 +0000 UTC m=+3.296465932" lastFinishedPulling="2026-06-03 15:03:13.748148964 +0000 UTC m=+21.101118982" observedRunningTime="2026-06-03 15:03:21.445336753 +0000 UTC m=+28.798306778" watchObservedRunningTime="2026-06-03 15:03:22.428108329 +0000 UTC m=+29.781078352" Jun 03 15:03:23.239829 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:23.239805 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:23.239975 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:23.239881 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wc5f" podUID="0d5c6c4b-7b87-42f1-b959-938ef9c698fc" Jun 03 15:03:23.239975 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:23.239907 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:23.240057 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:23.240032 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klxj7" podUID="80b3ece5-3176-4984-821a-d8817e635c90" Jun 03 15:03:25.239482 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:25.239446 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:25.239947 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:25.239489 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:25.239947 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:25.239575 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wc5f" podUID="0d5c6c4b-7b87-42f1-b959-938ef9c698fc" Jun 03 15:03:25.239947 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:25.239714 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klxj7" podUID="80b3ece5-3176-4984-821a-d8817e635c90" Jun 03 15:03:26.861054 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:26.861021 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs\") pod \"network-metrics-daemon-klxj7\" (UID: \"80b3ece5-3176-4984-821a-d8817e635c90\") " pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:26.861629 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:26.861138 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:26.861629 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:26.861186 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs podName:80b3ece5-3176-4984-821a-d8817e635c90 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:58.861173609 +0000 UTC m=+66.214143612 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs") pod "network-metrics-daemon-klxj7" (UID: "80b3ece5-3176-4984-821a-d8817e635c90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:26.961620 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:26.961579 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkh42\" (UniqueName: \"kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42\") pod \"network-check-target-6wc5f\" (UID: \"0d5c6c4b-7b87-42f1-b959-938ef9c698fc\") " pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:26.961817 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:26.961758 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:03:26.961817 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:26.961777 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:03:26.961817 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:26.961787 2577 projected.go:194] Error preparing data for projected volume kube-api-access-hkh42 for pod openshift-network-diagnostics/network-check-target-6wc5f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:26.961977 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:26.961846 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42 podName:0d5c6c4b-7b87-42f1-b959-938ef9c698fc nodeName:}" failed. No retries permitted until 2026-06-03 15:03:58.961828416 +0000 UTC m=+66.314798423 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hkh42" (UniqueName: "kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42") pod "network-check-target-6wc5f" (UID: "0d5c6c4b-7b87-42f1-b959-938ef9c698fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:27.239184 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.239101 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:27.239184 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.239129 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:27.239444 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:27.239260 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klxj7" podUID="80b3ece5-3176-4984-821a-d8817e635c90" Jun 03 15:03:27.239444 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:27.239418 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6wc5f" podUID="0d5c6c4b-7b87-42f1-b959-938ef9c698fc" Jun 03 15:03:27.918808 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.918778 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-78.ec2.internal" event="NodeReady" Jun 03 15:03:27.919414 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.918928 2577 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 15:03:27.975897 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.975862 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg"] Jun 03 15:03:27.988655 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.988448 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-774f88d448-wpp89"] Jun 03 15:03:27.988878 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.988854 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg" Jun 03 15:03:27.991474 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.991453 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tmjbd"] Jun 03 15:03:27.991627 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.991606 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:27.993644 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.993623 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 03 15:03:27.993795 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.993647 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 15:03:27.993795 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.993691 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 15:03:27.994334 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.994308 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 15:03:27.994588 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.994573 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 15:03:27.994705 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.994689 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 15:03:27.994798 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.994771 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-64cd489db9-fdf9z"] Jun 03 15:03:27.994990 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.994917 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tmjbd" Jun 03 15:03:27.997961 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.997939 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-lkk8x"] Jun 03 15:03:27.998097 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:27.998080 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:28.001248 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.001230 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw"] Jun 03 15:03:28.001455 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.001439 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.004319 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.004298 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh"] Jun 03 15:03:28.004724 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.004487 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw" Jun 03 15:03:28.005413 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.004996 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-24k7v\"" Jun 03 15:03:28.005413 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.005251 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 15:03:28.009027 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.009005 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:03:28.009877 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.009503 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh"] Jun 03 15:03:28.010247 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.010228 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 15:03:28.010483 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.010444 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 15:03:28.011980 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.011958 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wn4fl\"" Jun 03 15:03:28.013735 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.012634 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-86gkc\"" Jun 03 15:03:28.013735 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.009664 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 15:03:28.013735 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.009707 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 15:03:28.013735 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.009712 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 15:03:28.013735 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.013298 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 15:03:28.013735 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.013349 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:03:28.013735 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.013392 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4rbkc\"" Jun 03 15:03:28.013735 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.009577 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh" Jun 03 15:03:28.013735 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.009616 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 15:03:28.013735 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.009663 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 15:03:28.013735 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.009536 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 15:03:28.013735 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.013632 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 15:03:28.015857 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.015839 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-hskk5"] Jun 03 15:03:28.015988 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.015972 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" Jun 03 15:03:28.020991 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.020779 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-59r7c"] Jun 03 15:03:28.021204 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.021185 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" Jun 03 15:03:28.022470 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.022447 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-f2wvd\"" Jun 03 15:03:28.022563 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.022549 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 15:03:28.022685 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.022669 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 15:03:28.022753 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.022738 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 15:03:28.022808 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.022765 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 15:03:28.023070 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.023047 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 15:03:28.023650 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.023632 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 15:03:28.024585 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.024524 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bb8d97579-px8fb"] Jun 03 15:03:28.024849 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.024809 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-59r7c" Jun 03 15:03:28.025100 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.025028 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 15:03:28.025623 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.025591 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 15:03:28.025827 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.025807 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wl52x\"" Jun 03 15:03:28.026051 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.026036 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 15:03:28.027268 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.027145 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:03:28.027459 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.027415 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-f2lnk\"" Jun 03 15:03:28.027529 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.027470 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 15:03:28.027717 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.027697 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 15:03:28.027816 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.027704 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss"] Jun 03 15:03:28.027910 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.027798 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.030413 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.030389 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 15:03:28.030689 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.030667 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-rdm7h"] Jun 03 15:03:28.030834 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.030759 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss" Jun 03 15:03:28.031512 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.031494 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 15:03:28.031642 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.031527 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:03:28.034214 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.034191 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hwv8v\"" Jun 03 15:03:28.034560 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.034539 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 15:03:28.035665 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.034814 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 15:03:28.035665 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.034191 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-l2s4d\"" Jun 03 15:03:28.035665 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.034308 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 15:03:28.035918 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.035719 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c7c989c4-rp4cx"] Jun 03 15:03:28.036016 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.035998 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-rdm7h" Jun 03 15:03:28.037268 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.037249 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 15:03:28.037713 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.037695 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 15:03:28.039259 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.038895 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4"] Jun 03 15:03:28.039259 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.038943 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 15:03:28.039259 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.039023 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 15:03:28.039259 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.039065 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 15:03:28.039259 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.039096 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:03:28.039555 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.039273 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xx6pq\"" Jun 03 15:03:28.039555 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.039388 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c7c989c4-rp4cx" Jun 03 15:03:28.040227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.040208 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mk9m8\"" Jun 03 15:03:28.040423 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.040402 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 15:03:28.040584 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.040540 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 15:03:28.042325 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.042237 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 15:03:28.042441 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.042342 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tmjbd"] Jun 03 15:03:28.042441 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.042378 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-lkk8x"] Jun 03 15:03:28.042441 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.042394 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-774f88d448-wpp89"] Jun 03 15:03:28.042441 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.042405 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw"] Jun 03 15:03:28.042441 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.042416 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-rdm7h"] Jun 03 15:03:28.042441 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.042427 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg"] Jun 03 15:03:28.042441 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.042438 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh"] Jun 03 15:03:28.042441 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.042450 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gbhfn"] Jun 03 15:03:28.042982 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.042459 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.042982 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.042403 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-pbxrd\"" Jun 03 15:03:28.047765 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.047736 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 15:03:28.048017 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.047998 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 15:03:28.048315 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.048021 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 15:03:28.050173 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.050107 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 15:03:28.050305 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.050272 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64cd489db9-fdf9z"] Jun 03 15:03:28.050305 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.050303 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bb8d97579-px8fb"] Jun 03 15:03:28.050451 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.050424 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbhfn" Jun 03 15:03:28.054896 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.054504 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 15:03:28.054896 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.054729 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 15:03:28.055055 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.054960 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m5pnr\"" Jun 03 15:03:28.055245 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.055219 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-59r7c"] Jun 03 15:03:28.055502 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.055481 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gbhfn"] Jun 03 15:03:28.056569 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.056245 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh"] Jun 03 15:03:28.057046 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.057012 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss"] Jun 03 15:03:28.057880 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.057863 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-hskk5"] Jun 03 15:03:28.062186 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.062148 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c7c989c4-rp4cx"] Jun 03 15:03:28.069339 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.069207 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/866c3310-011a-4ab6-b677-93e8eeabd1d6-image-registry-private-configuration\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.069339 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.069252 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.069339 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.069280 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-certificates\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.069339 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.069327 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/866c3310-011a-4ab6-b677-93e8eeabd1d6-installation-pull-secrets\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.069586 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.069417 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-bound-sa-token\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.069586 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.069460 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/866c3310-011a-4ab6-b677-93e8eeabd1d6-trusted-ca\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.069586 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.069555 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkmdw\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-kube-api-access-bkmdw\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.069721 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.069593 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a494f74-e51e-4ac2-8e9f-d063147ae467-tmp\") pod \"klusterlet-addon-workmgr-75c59dc554-qjbfg\" (UID: \"3a494f74-e51e-4ac2-8e9f-d063147ae467\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg" Jun 03 15:03:28.069721 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.069610 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxw7t\" (UniqueName: \"kubernetes.io/projected/3a494f74-e51e-4ac2-8e9f-d063147ae467-kube-api-access-sxw7t\") pod \"klusterlet-addon-workmgr-75c59dc554-qjbfg\" (UID: \"3a494f74-e51e-4ac2-8e9f-d063147ae467\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg" Jun 03 15:03:28.069721 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.069639 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/866c3310-011a-4ab6-b677-93e8eeabd1d6-ca-trust-extracted\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.069721 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.069717 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3a494f74-e51e-4ac2-8e9f-d063147ae467-klusterlet-config\") pod \"klusterlet-addon-workmgr-75c59dc554-qjbfg\" (UID: \"3a494f74-e51e-4ac2-8e9f-d063147ae467\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg" Jun 03 15:03:28.075790 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.075747 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4"] Jun 03 15:03:28.094787 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.094764 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wp7ml"] Jun 03 15:03:28.099220 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.099203 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wp7ml" Jun 03 15:03:28.101991 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.101971 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 15:03:28.102076 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.101993 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p69ds\"" Jun 03 15:03:28.102076 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.102024 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 15:03:28.102246 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.102230 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 15:03:28.114646 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.114124 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wp7ml"] Jun 03 15:03:28.170415 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170327 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/acc4bf03-9c54-471c-a6eb-2dec415170d6-ca\") pod \"cluster-proxy-proxy-agent-c5d7dcc84-58rn4\" (UID: \"acc4bf03-9c54-471c-a6eb-2dec415170d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.170415 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170358 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/acc4bf03-9c54-471c-a6eb-2dec415170d6-hub\") pod \"cluster-proxy-proxy-agent-c5d7dcc84-58rn4\" (UID: \"acc4bf03-9c54-471c-a6eb-2dec415170d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.170415 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170400 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/acc4bf03-9c54-471c-a6eb-2dec415170d6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c5d7dcc84-58rn4\" (UID: \"acc4bf03-9c54-471c-a6eb-2dec415170d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.170661 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170428 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05144d0b-dd83-4d3c-9b43-4480b3fc8a35-trusted-ca\") pod \"console-operator-86d7c6cc77-hskk5\" (UID: \"05144d0b-dd83-4d3c-9b43-4480b3fc8a35\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" Jun 03 15:03:28.170661 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170449 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c1d6767-775a-4feb-ab75-d42366001da8-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-vzpss\" (UID: \"6c1d6767-775a-4feb-ab75-d42366001da8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss" Jun 03 15:03:28.170661 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170474 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-88whh\" (UID: \"399fce46-fa37-43a7-b31e-0e5848d3735e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" Jun 03 15:03:28.170661 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170512 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/466be55f-b28b-4b72-979e-b679d95de62c-config-volume\") pod \"dns-default-gbhfn\" (UID: \"466be55f-b28b-4b72-979e-b679d95de62c\") " pod="openshift-dns/dns-default-gbhfn" Jun 03 15:03:28.170661 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1536eb21-7935-4dc8-8066-9e6d7e6c3ab5-service-ca-bundle\") pod \"insights-operator-788bf58df5-lkk8x\" (UID: \"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5\") " pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.170661 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170616 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsh2l\" (UniqueName: \"kubernetes.io/projected/6c1d6767-775a-4feb-ab75-d42366001da8-kube-api-access-qsh2l\") pod \"kube-storage-version-migrator-operator-96ddc787c-vzpss\" (UID: \"6c1d6767-775a-4feb-ab75-d42366001da8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss" Jun 03 15:03:28.170661 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170647 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/866c3310-011a-4ab6-b677-93e8eeabd1d6-image-registry-private-configuration\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.170986 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170676 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/866c3310-011a-4ab6-b677-93e8eeabd1d6-trusted-ca\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.170986 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170699 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1536eb21-7935-4dc8-8066-9e6d7e6c3ab5-serving-cert\") pod \"insights-operator-788bf58df5-lkk8x\" (UID: \"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5\") " pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.170986 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170729 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-stats-auth\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:28.170986 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170762 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04be6e74-740f-48d9-a3f6-32f7466b9520-config\") pod \"service-ca-operator-69877444c-59r7c\" (UID: \"04be6e74-740f-48d9-a3f6-32f7466b9520\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-59r7c" Jun 03 15:03:28.170986 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170788 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqt4g\" (UniqueName: \"kubernetes.io/projected/466be55f-b28b-4b72-979e-b679d95de62c-kube-api-access-vqt4g\") pod \"dns-default-gbhfn\" (UID: \"466be55f-b28b-4b72-979e-b679d95de62c\") " pod="openshift-dns/dns-default-gbhfn" Jun 03 15:03:28.170986 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170811 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-image-registry-private-configuration\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.170986 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170836 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a300de4-981a-4bee-8f25-c25a10a85d29-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-fdjbh\" (UID: \"3a300de4-981a-4bee-8f25-c25a10a85d29\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh" Jun 03 15:03:28.170986 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170864 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.170986 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170887 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-trusted-ca\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.170986 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpqjd\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-kube-api-access-lpqjd\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.170986 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vg8k\" (UniqueName: \"kubernetes.io/projected/c6b8dc06-9393-43f8-a071-e7ef74839d86-kube-api-access-5vg8k\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:28.170986 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170964 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/acc4bf03-9c54-471c-a6eb-2dec415170d6-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-c5d7dcc84-58rn4\" (UID: \"acc4bf03-9c54-471c-a6eb-2dec415170d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.170986 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.170986 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/acc4bf03-9c54-471c-a6eb-2dec415170d6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c5d7dcc84-58rn4\" (UID: \"acc4bf03-9c54-471c-a6eb-2dec415170d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.171538 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171010 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/866c3310-011a-4ab6-b677-93e8eeabd1d6-installation-pull-secrets\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.171538 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171031 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-bound-sa-token\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.171538 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171053 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-ndlpw\" (UID: \"e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw" Jun 03 15:03:28.171538 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171077 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c1d6767-775a-4feb-ab75-d42366001da8-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-vzpss\" (UID: \"6c1d6767-775a-4feb-ab75-d42366001da8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss" Jun 03 15:03:28.171538 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171099 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1536eb21-7935-4dc8-8066-9e6d7e6c3ab5-snapshots\") pod \"insights-operator-788bf58df5-lkk8x\" (UID: \"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5\") " pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.171538 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171120 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l7ng\" (UniqueName: \"kubernetes.io/projected/1536eb21-7935-4dc8-8066-9e6d7e6c3ab5-kube-api-access-8l7ng\") pod \"insights-operator-788bf58df5-lkk8x\" (UID: \"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5\") " pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.171538 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171141 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-installation-pull-secrets\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.171538 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171174 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bkmdw\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-kube-api-access-bkmdw\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.171538 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-default-certificate\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:28.171538 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:28.171538 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171238 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05144d0b-dd83-4d3c-9b43-4480b3fc8a35-config\") pod \"console-operator-86d7c6cc77-hskk5\" (UID: \"05144d0b-dd83-4d3c-9b43-4480b3fc8a35\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" Jun 03 15:03:28.171538 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171263 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/399fce46-fa37-43a7-b31e-0e5848d3735e-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-88whh\" (UID: \"399fce46-fa37-43a7-b31e-0e5848d3735e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" Jun 03 15:03:28.171538 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171306 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxw7t\" (UniqueName: \"kubernetes.io/projected/3a494f74-e51e-4ac2-8e9f-d063147ae467-kube-api-access-sxw7t\") pod \"klusterlet-addon-workmgr-75c59dc554-qjbfg\" (UID: \"3a494f74-e51e-4ac2-8e9f-d063147ae467\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg" Jun 03 15:03:28.171538 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171331 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/866c3310-011a-4ab6-b677-93e8eeabd1d6-ca-trust-extracted\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.171538 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171396 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p469j\" (UniqueName: \"kubernetes.io/projected/399fce46-fa37-43a7-b31e-0e5848d3735e-kube-api-access-p469j\") pod \"cluster-monitoring-operator-69b6cbdb88-88whh\" (UID: \"399fce46-fa37-43a7-b31e-0e5848d3735e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" Jun 03 15:03:28.172262 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171658 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhw6c\" (UniqueName: \"kubernetes.io/projected/aa816b3b-352e-425b-b91e-2a721b0b4f51-kube-api-access-rhw6c\") pod \"network-check-source-56d84b9f44-rdm7h\" (UID: \"aa816b3b-352e-425b-b91e-2a721b0b4f51\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-rdm7h" Jun 03 15:03:28.172262 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171695 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/466be55f-b28b-4b72-979e-b679d95de62c-tmp-dir\") pod \"dns-default-gbhfn\" (UID: \"466be55f-b28b-4b72-979e-b679d95de62c\") " pod="openshift-dns/dns-default-gbhfn" Jun 03 15:03:28.172262 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171718 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/866c3310-011a-4ab6-b677-93e8eeabd1d6-trusted-ca\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.172262 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171725 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-bound-sa-token\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.172262 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171715 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/866c3310-011a-4ab6-b677-93e8eeabd1d6-ca-trust-extracted\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.172262 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171804 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3a494f74-e51e-4ac2-8e9f-d063147ae467-klusterlet-config\") pod \"klusterlet-addon-workmgr-75c59dc554-qjbfg\" (UID: \"3a494f74-e51e-4ac2-8e9f-d063147ae467\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg" Jun 03 15:03:28.172262 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171836 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:28.172262 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-certificates\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.172262 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.171967 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05144d0b-dd83-4d3c-9b43-4480b3fc8a35-serving-cert\") pod \"console-operator-86d7c6cc77-hskk5\" (UID: \"05144d0b-dd83-4d3c-9b43-4480b3fc8a35\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" Jun 03 15:03:28.172262 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.172017 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1536eb21-7935-4dc8-8066-9e6d7e6c3ab5-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-lkk8x\" (UID: \"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5\") " pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.172262 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.172090 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngfd5\" (UniqueName: \"kubernetes.io/projected/acc4bf03-9c54-471c-a6eb-2dec415170d6-kube-api-access-ngfd5\") pod \"cluster-proxy-proxy-agent-c5d7dcc84-58rn4\" (UID: \"acc4bf03-9c54-471c-a6eb-2dec415170d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.172262 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.172154 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04be6e74-740f-48d9-a3f6-32f7466b9520-serving-cert\") pod \"service-ca-operator-69877444c-59r7c\" (UID: \"04be6e74-740f-48d9-a3f6-32f7466b9520\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-59r7c" Jun 03 15:03:28.172262 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.172199 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a78c9d2a-e01f-42d2-bd99-11ead85f8dde-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64c7c989c4-rp4cx\" (UID: \"a78c9d2a-e01f-42d2-bd99-11ead85f8dde\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c7c989c4-rp4cx" Jun 03 15:03:28.172262 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.172232 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-ca-trust-extracted\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.172948 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.172295 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.172948 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.172340 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-certificates\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.172948 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.172410 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp4fd\" (UniqueName: \"kubernetes.io/projected/2cf31970-1119-4806-b4e0-0e26a630594a-kube-api-access-cp4fd\") pod \"volume-data-source-validator-7598fd5bd-tmjbd\" (UID: \"2cf31970-1119-4806-b4e0-0e26a630594a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tmjbd" Jun 03 15:03:28.172948 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.172455 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t57qs\" (UniqueName: \"kubernetes.io/projected/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-kube-api-access-t57qs\") pod \"cluster-samples-operator-755bbf9bfb-ndlpw\" (UID: \"e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw" Jun 03 15:03:28.172948 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.172492 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l8md\" (UniqueName: \"kubernetes.io/projected/05144d0b-dd83-4d3c-9b43-4480b3fc8a35-kube-api-access-6l8md\") pod \"console-operator-86d7c6cc77-hskk5\" (UID: \"05144d0b-dd83-4d3c-9b43-4480b3fc8a35\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" Jun 03 15:03:28.172948 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.172520 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-fdjbh\" (UID: \"3a300de4-981a-4bee-8f25-c25a10a85d29\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh" Jun 03 15:03:28.172948 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.172551 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bh5s\" (UniqueName: \"kubernetes.io/projected/a78c9d2a-e01f-42d2-bd99-11ead85f8dde-kube-api-access-9bh5s\") pod \"managed-serviceaccount-addon-agent-64c7c989c4-rp4cx\" (UID: \"a78c9d2a-e01f-42d2-bd99-11ead85f8dde\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c7c989c4-rp4cx" Jun 03 15:03:28.172948 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.172576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls\") pod \"dns-default-gbhfn\" (UID: \"466be55f-b28b-4b72-979e-b679d95de62c\") " pod="openshift-dns/dns-default-gbhfn" Jun 03 15:03:28.172948 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.172615 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a494f74-e51e-4ac2-8e9f-d063147ae467-tmp\") pod \"klusterlet-addon-workmgr-75c59dc554-qjbfg\" (UID: \"3a494f74-e51e-4ac2-8e9f-d063147ae467\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg" Jun 03 15:03:28.172948 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.172687 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:03:28.172948 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.172706 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774f88d448-wpp89: secret "image-registry-tls" not found Jun 03 15:03:28.172948 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.172746 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1536eb21-7935-4dc8-8066-9e6d7e6c3ab5-tmp\") pod \"insights-operator-788bf58df5-lkk8x\" (UID: \"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5\") " pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.173541 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.173042 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a494f74-e51e-4ac2-8e9f-d063147ae467-tmp\") pod \"klusterlet-addon-workmgr-75c59dc554-qjbfg\" (UID: \"3a494f74-e51e-4ac2-8e9f-d063147ae467\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg" Jun 03 15:03:28.173541 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.173096 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9vvs\" (UniqueName: \"kubernetes.io/projected/04be6e74-740f-48d9-a3f6-32f7466b9520-kube-api-access-p9vvs\") pod \"service-ca-operator-69877444c-59r7c\" (UID: \"04be6e74-740f-48d9-a3f6-32f7466b9520\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-59r7c" Jun 03 15:03:28.173541 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.173228 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls podName:866c3310-011a-4ab6-b677-93e8eeabd1d6 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:28.673208462 +0000 UTC m=+36.026178467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls") pod "image-registry-774f88d448-wpp89" (UID: "866c3310-011a-4ab6-b677-93e8eeabd1d6") : secret "image-registry-tls" not found Jun 03 15:03:28.173707 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.173685 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-certificates\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.176409 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.176351 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/866c3310-011a-4ab6-b677-93e8eeabd1d6-installation-pull-secrets\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.176409 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.176402 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/866c3310-011a-4ab6-b677-93e8eeabd1d6-image-registry-private-configuration\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.176545 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.176483 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3a494f74-e51e-4ac2-8e9f-d063147ae467-klusterlet-config\") pod \"klusterlet-addon-workmgr-75c59dc554-qjbfg\" (UID: \"3a494f74-e51e-4ac2-8e9f-d063147ae467\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg" Jun 03 15:03:28.192182 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.192145 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkmdw\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-kube-api-access-bkmdw\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.193327 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.193297 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-bound-sa-token\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.196706 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.196681 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxw7t\" (UniqueName: \"kubernetes.io/projected/3a494f74-e51e-4ac2-8e9f-d063147ae467-kube-api-access-sxw7t\") pod \"klusterlet-addon-workmgr-75c59dc554-qjbfg\" (UID: \"3a494f74-e51e-4ac2-8e9f-d063147ae467\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg" Jun 03 15:03:28.274102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274066 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1536eb21-7935-4dc8-8066-9e6d7e6c3ab5-tmp\") pod \"insights-operator-788bf58df5-lkk8x\" (UID: \"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5\") " pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.274292 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274117 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p9vvs\" (UniqueName: \"kubernetes.io/projected/04be6e74-740f-48d9-a3f6-32f7466b9520-kube-api-access-p9vvs\") pod \"service-ca-operator-69877444c-59r7c\" (UID: \"04be6e74-740f-48d9-a3f6-32f7466b9520\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-59r7c" Jun 03 15:03:28.274292 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274137 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/acc4bf03-9c54-471c-a6eb-2dec415170d6-ca\") pod \"cluster-proxy-proxy-agent-c5d7dcc84-58rn4\" (UID: \"acc4bf03-9c54-471c-a6eb-2dec415170d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.274292 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274159 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/acc4bf03-9c54-471c-a6eb-2dec415170d6-hub\") pod \"cluster-proxy-proxy-agent-c5d7dcc84-58rn4\" (UID: \"acc4bf03-9c54-471c-a6eb-2dec415170d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.274292 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274184 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/acc4bf03-9c54-471c-a6eb-2dec415170d6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c5d7dcc84-58rn4\" (UID: \"acc4bf03-9c54-471c-a6eb-2dec415170d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.274292 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274211 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05144d0b-dd83-4d3c-9b43-4480b3fc8a35-trusted-ca\") pod \"console-operator-86d7c6cc77-hskk5\" (UID: \"05144d0b-dd83-4d3c-9b43-4480b3fc8a35\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" Jun 03 15:03:28.274292 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274234 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c1d6767-775a-4feb-ab75-d42366001da8-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-vzpss\" (UID: \"6c1d6767-775a-4feb-ab75-d42366001da8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss" Jun 03 15:03:28.274292 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274257 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-88whh\" (UID: \"399fce46-fa37-43a7-b31e-0e5848d3735e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" Jun 03 15:03:28.274292 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274281 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/466be55f-b28b-4b72-979e-b679d95de62c-config-volume\") pod \"dns-default-gbhfn\" (UID: \"466be55f-b28b-4b72-979e-b679d95de62c\") " pod="openshift-dns/dns-default-gbhfn" Jun 03 15:03:28.274725 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274308 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdvdb\" (UniqueName: \"kubernetes.io/projected/747b2535-7bfc-402d-ab7c-b645e8c06569-kube-api-access-jdvdb\") pod \"ingress-canary-wp7ml\" (UID: \"747b2535-7bfc-402d-ab7c-b645e8c06569\") " pod="openshift-ingress-canary/ingress-canary-wp7ml" Jun 03 15:03:28.274725 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274338 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1536eb21-7935-4dc8-8066-9e6d7e6c3ab5-service-ca-bundle\") pod \"insights-operator-788bf58df5-lkk8x\" (UID: \"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5\") " pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.274725 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274400 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qsh2l\" (UniqueName: \"kubernetes.io/projected/6c1d6767-775a-4feb-ab75-d42366001da8-kube-api-access-qsh2l\") pod \"kube-storage-version-migrator-operator-96ddc787c-vzpss\" (UID: \"6c1d6767-775a-4feb-ab75-d42366001da8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss" Jun 03 15:03:28.274725 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274452 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1536eb21-7935-4dc8-8066-9e6d7e6c3ab5-serving-cert\") pod \"insights-operator-788bf58df5-lkk8x\" (UID: \"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5\") " pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.274725 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274478 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-stats-auth\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:28.274725 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.274486 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 15:03:28.274725 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274488 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1536eb21-7935-4dc8-8066-9e6d7e6c3ab5-tmp\") pod \"insights-operator-788bf58df5-lkk8x\" (UID: \"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5\") " pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.274725 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274513 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04be6e74-740f-48d9-a3f6-32f7466b9520-config\") pod \"service-ca-operator-69877444c-59r7c\" (UID: \"04be6e74-740f-48d9-a3f6-32f7466b9520\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-59r7c" Jun 03 15:03:28.274725 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274539 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vqt4g\" (UniqueName: \"kubernetes.io/projected/466be55f-b28b-4b72-979e-b679d95de62c-kube-api-access-vqt4g\") pod \"dns-default-gbhfn\" (UID: \"466be55f-b28b-4b72-979e-b679d95de62c\") " pod="openshift-dns/dns-default-gbhfn" Jun 03 15:03:28.274725 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.274549 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls podName:399fce46-fa37-43a7-b31e-0e5848d3735e nodeName:}" failed. No retries permitted until 2026-06-03 15:03:28.774534885 +0000 UTC m=+36.127504894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-88whh" (UID: "399fce46-fa37-43a7-b31e-0e5848d3735e") : secret "cluster-monitoring-operator-tls" not found Jun 03 15:03:28.274725 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274577 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-image-registry-private-configuration\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.274725 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274605 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a300de4-981a-4bee-8f25-c25a10a85d29-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-fdjbh\" (UID: \"3a300de4-981a-4bee-8f25-c25a10a85d29\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh" Jun 03 15:03:28.274725 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274646 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.274725 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274670 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-trusted-ca\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.274725 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274694 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lpqjd\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-kube-api-access-lpqjd\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.275452 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274747 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vg8k\" (UniqueName: \"kubernetes.io/projected/c6b8dc06-9393-43f8-a071-e7ef74839d86-kube-api-access-5vg8k\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:28.275452 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274774 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/acc4bf03-9c54-471c-a6eb-2dec415170d6-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-c5d7dcc84-58rn4\" (UID: \"acc4bf03-9c54-471c-a6eb-2dec415170d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.275452 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274798 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/acc4bf03-9c54-471c-a6eb-2dec415170d6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c5d7dcc84-58rn4\" (UID: \"acc4bf03-9c54-471c-a6eb-2dec415170d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.275452 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274831 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-ndlpw\" (UID: \"e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw" Jun 03 15:03:28.275452 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274857 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c1d6767-775a-4feb-ab75-d42366001da8-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-vzpss\" (UID: \"6c1d6767-775a-4feb-ab75-d42366001da8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss" Jun 03 15:03:28.275452 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274890 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1536eb21-7935-4dc8-8066-9e6d7e6c3ab5-snapshots\") pod \"insights-operator-788bf58df5-lkk8x\" (UID: \"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5\") " pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.275452 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274915 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8l7ng\" (UniqueName: \"kubernetes.io/projected/1536eb21-7935-4dc8-8066-9e6d7e6c3ab5-kube-api-access-8l7ng\") pod \"insights-operator-788bf58df5-lkk8x\" (UID: \"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5\") " pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.275452 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.274963 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-installation-pull-secrets\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.275452 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275002 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert\") pod \"ingress-canary-wp7ml\" (UID: \"747b2535-7bfc-402d-ab7c-b645e8c06569\") " pod="openshift-ingress-canary/ingress-canary-wp7ml" Jun 03 15:03:28.275452 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275051 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-default-certificate\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:28.275452 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275077 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:28.275452 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275106 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05144d0b-dd83-4d3c-9b43-4480b3fc8a35-config\") pod \"console-operator-86d7c6cc77-hskk5\" (UID: \"05144d0b-dd83-4d3c-9b43-4480b3fc8a35\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" Jun 03 15:03:28.275452 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275126 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1536eb21-7935-4dc8-8066-9e6d7e6c3ab5-service-ca-bundle\") pod \"insights-operator-788bf58df5-lkk8x\" (UID: \"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5\") " pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.275452 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275132 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/399fce46-fa37-43a7-b31e-0e5848d3735e-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-88whh\" (UID: \"399fce46-fa37-43a7-b31e-0e5848d3735e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" Jun 03 15:03:28.275452 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275176 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p469j\" (UniqueName: \"kubernetes.io/projected/399fce46-fa37-43a7-b31e-0e5848d3735e-kube-api-access-p469j\") pod \"cluster-monitoring-operator-69b6cbdb88-88whh\" (UID: \"399fce46-fa37-43a7-b31e-0e5848d3735e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" Jun 03 15:03:28.276199 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275209 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rhw6c\" (UniqueName: \"kubernetes.io/projected/aa816b3b-352e-425b-b91e-2a721b0b4f51-kube-api-access-rhw6c\") pod \"network-check-source-56d84b9f44-rdm7h\" (UID: \"aa816b3b-352e-425b-b91e-2a721b0b4f51\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-rdm7h" Jun 03 15:03:28.276199 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275238 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/466be55f-b28b-4b72-979e-b679d95de62c-tmp-dir\") pod \"dns-default-gbhfn\" (UID: \"466be55f-b28b-4b72-979e-b679d95de62c\") " pod="openshift-dns/dns-default-gbhfn" Jun 03 15:03:28.276199 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275264 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-bound-sa-token\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.276199 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275292 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:28.276199 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275321 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-certificates\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.276199 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275337 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05144d0b-dd83-4d3c-9b43-4480b3fc8a35-trusted-ca\") pod \"console-operator-86d7c6cc77-hskk5\" (UID: \"05144d0b-dd83-4d3c-9b43-4480b3fc8a35\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" Jun 03 15:03:28.276199 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275350 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05144d0b-dd83-4d3c-9b43-4480b3fc8a35-serving-cert\") pod \"console-operator-86d7c6cc77-hskk5\" (UID: \"05144d0b-dd83-4d3c-9b43-4480b3fc8a35\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" Jun 03 15:03:28.276199 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275391 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a300de4-981a-4bee-8f25-c25a10a85d29-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-fdjbh\" (UID: \"3a300de4-981a-4bee-8f25-c25a10a85d29\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh" Jun 03 15:03:28.276199 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.275405 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:03:28.276199 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275412 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1536eb21-7935-4dc8-8066-9e6d7e6c3ab5-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-lkk8x\" (UID: \"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5\") " pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.276199 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.275421 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb8d97579-px8fb: secret "image-registry-tls" not found Jun 03 15:03:28.276199 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275450 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ngfd5\" (UniqueName: \"kubernetes.io/projected/acc4bf03-9c54-471c-a6eb-2dec415170d6-kube-api-access-ngfd5\") pod \"cluster-proxy-proxy-agent-c5d7dcc84-58rn4\" (UID: \"acc4bf03-9c54-471c-a6eb-2dec415170d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.276199 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.275479 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls podName:f5cc1a7b-de22-4984-94d2-a6c717d2acf3 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:28.77546109 +0000 UTC m=+36.128431127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls") pod "image-registry-bb8d97579-px8fb" (UID: "f5cc1a7b-de22-4984-94d2-a6c717d2acf3") : secret "image-registry-tls" not found Jun 03 15:03:28.276199 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275513 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04be6e74-740f-48d9-a3f6-32f7466b9520-serving-cert\") pod \"service-ca-operator-69877444c-59r7c\" (UID: \"04be6e74-740f-48d9-a3f6-32f7466b9520\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-59r7c" Jun 03 15:03:28.276199 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275547 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a78c9d2a-e01f-42d2-bd99-11ead85f8dde-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64c7c989c4-rp4cx\" (UID: \"a78c9d2a-e01f-42d2-bd99-11ead85f8dde\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c7c989c4-rp4cx" Jun 03 15:03:28.276199 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275575 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-ca-trust-extracted\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.276989 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275648 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cp4fd\" (UniqueName: \"kubernetes.io/projected/2cf31970-1119-4806-b4e0-0e26a630594a-kube-api-access-cp4fd\") pod \"volume-data-source-validator-7598fd5bd-tmjbd\" (UID: \"2cf31970-1119-4806-b4e0-0e26a630594a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tmjbd" Jun 03 15:03:28.276989 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275684 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t57qs\" (UniqueName: \"kubernetes.io/projected/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-kube-api-access-t57qs\") pod \"cluster-samples-operator-755bbf9bfb-ndlpw\" (UID: \"e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw" Jun 03 15:03:28.276989 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275716 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6l8md\" (UniqueName: \"kubernetes.io/projected/05144d0b-dd83-4d3c-9b43-4480b3fc8a35-kube-api-access-6l8md\") pod \"console-operator-86d7c6cc77-hskk5\" (UID: \"05144d0b-dd83-4d3c-9b43-4480b3fc8a35\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" Jun 03 15:03:28.276989 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275759 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-fdjbh\" (UID: \"3a300de4-981a-4bee-8f25-c25a10a85d29\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh" Jun 03 15:03:28.276989 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275800 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bh5s\" (UniqueName: \"kubernetes.io/projected/a78c9d2a-e01f-42d2-bd99-11ead85f8dde-kube-api-access-9bh5s\") pod \"managed-serviceaccount-addon-agent-64c7c989c4-rp4cx\" (UID: \"a78c9d2a-e01f-42d2-bd99-11ead85f8dde\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c7c989c4-rp4cx" Jun 03 15:03:28.276989 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.275833 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls\") pod \"dns-default-gbhfn\" (UID: \"466be55f-b28b-4b72-979e-b679d95de62c\") " pod="openshift-dns/dns-default-gbhfn" Jun 03 15:03:28.276989 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.275972 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:03:28.276989 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.276021 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls podName:466be55f-b28b-4b72-979e-b679d95de62c nodeName:}" failed. No retries permitted until 2026-06-03 15:03:28.77600698 +0000 UTC m=+36.128976984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls") pod "dns-default-gbhfn" (UID: "466be55f-b28b-4b72-979e-b679d95de62c") : secret "dns-default-metrics-tls" not found Jun 03 15:03:28.276989 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.276354 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/466be55f-b28b-4b72-979e-b679d95de62c-tmp-dir\") pod \"dns-default-gbhfn\" (UID: \"466be55f-b28b-4b72-979e-b679d95de62c\") " pod="openshift-dns/dns-default-gbhfn" Jun 03 15:03:28.276989 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.276645 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 15:03:28.276989 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.276726 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs podName:c6b8dc06-9393-43f8-a071-e7ef74839d86 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:28.776710518 +0000 UTC m=+36.129680539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs") pod "router-default-64cd489db9-fdf9z" (UID: "c6b8dc06-9393-43f8-a071-e7ef74839d86") : secret "router-metrics-certs-default" not found Jun 03 15:03:28.277537 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.277033 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-trusted-ca\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.277537 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.277183 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-certificates\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.278495 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.278160 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-installation-pull-secrets\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.278495 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.278176 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/acc4bf03-9c54-471c-a6eb-2dec415170d6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c5d7dcc84-58rn4\" (UID: \"acc4bf03-9c54-471c-a6eb-2dec415170d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.278495 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.278284 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 15:03:28.278495 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.278337 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls podName:e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:28.778320311 +0000 UTC m=+36.131290318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-ndlpw" (UID: "e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53") : secret "samples-operator-tls" not found Jun 03 15:03:28.280482 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.278960 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c1d6767-775a-4feb-ab75-d42366001da8-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-vzpss\" (UID: \"6c1d6767-775a-4feb-ab75-d42366001da8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss" Jun 03 15:03:28.280482 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.279297 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-stats-auth\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:28.280482 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.279386 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1536eb21-7935-4dc8-8066-9e6d7e6c3ab5-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-lkk8x\" (UID: \"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5\") " pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.280482 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.279467 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1536eb21-7935-4dc8-8066-9e6d7e6c3ab5-snapshots\") pod \"insights-operator-788bf58df5-lkk8x\" (UID: \"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5\") " pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.280482 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.279591 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04be6e74-740f-48d9-a3f6-32f7466b9520-config\") pod \"service-ca-operator-69877444c-59r7c\" (UID: \"04be6e74-740f-48d9-a3f6-32f7466b9520\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-59r7c" Jun 03 15:03:28.280482 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.279665 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/466be55f-b28b-4b72-979e-b679d95de62c-config-volume\") pod \"dns-default-gbhfn\" (UID: \"466be55f-b28b-4b72-979e-b679d95de62c\") " pod="openshift-dns/dns-default-gbhfn" Jun 03 15:03:28.280482 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.279686 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle podName:c6b8dc06-9393-43f8-a071-e7ef74839d86 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:28.779671187 +0000 UTC m=+36.132641200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle") pod "router-default-64cd489db9-fdf9z" (UID: "c6b8dc06-9393-43f8-a071-e7ef74839d86") : configmap references non-existent config key: service-ca.crt Jun 03 15:03:28.280482 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.279699 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-image-registry-private-configuration\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.280482 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.279775 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 15:03:28.280482 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.279814 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert podName:3a300de4-981a-4bee-8f25-c25a10a85d29 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:28.779802105 +0000 UTC m=+36.132772113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-fdjbh" (UID: "3a300de4-981a-4bee-8f25-c25a10a85d29") : secret "networking-console-plugin-cert" not found Jun 03 15:03:28.280482 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.279853 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05144d0b-dd83-4d3c-9b43-4480b3fc8a35-config\") pod \"console-operator-86d7c6cc77-hskk5\" (UID: \"05144d0b-dd83-4d3c-9b43-4480b3fc8a35\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" Jun 03 15:03:28.280482 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.280100 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/acc4bf03-9c54-471c-a6eb-2dec415170d6-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-c5d7dcc84-58rn4\" (UID: \"acc4bf03-9c54-471c-a6eb-2dec415170d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.282242 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.282211 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/acc4bf03-9c54-471c-a6eb-2dec415170d6-hub\") pod \"cluster-proxy-proxy-agent-c5d7dcc84-58rn4\" (UID: \"acc4bf03-9c54-471c-a6eb-2dec415170d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.282696 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.282666 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/acc4bf03-9c54-471c-a6eb-2dec415170d6-ca\") pod \"cluster-proxy-proxy-agent-c5d7dcc84-58rn4\" (UID: \"acc4bf03-9c54-471c-a6eb-2dec415170d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.282801 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.282786 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/399fce46-fa37-43a7-b31e-0e5848d3735e-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-88whh\" (UID: \"399fce46-fa37-43a7-b31e-0e5848d3735e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" Jun 03 15:03:28.284433 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.282957 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a78c9d2a-e01f-42d2-bd99-11ead85f8dde-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64c7c989c4-rp4cx\" (UID: \"a78c9d2a-e01f-42d2-bd99-11ead85f8dde\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c7c989c4-rp4cx" Jun 03 15:03:28.284433 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.282967 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05144d0b-dd83-4d3c-9b43-4480b3fc8a35-serving-cert\") pod \"console-operator-86d7c6cc77-hskk5\" (UID: \"05144d0b-dd83-4d3c-9b43-4480b3fc8a35\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" Jun 03 15:03:28.284433 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.282963 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/acc4bf03-9c54-471c-a6eb-2dec415170d6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c5d7dcc84-58rn4\" (UID: \"acc4bf03-9c54-471c-a6eb-2dec415170d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.284433 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.283019 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-ca-trust-extracted\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.284433 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.283145 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04be6e74-740f-48d9-a3f6-32f7466b9520-serving-cert\") pod \"service-ca-operator-69877444c-59r7c\" (UID: \"04be6e74-740f-48d9-a3f6-32f7466b9520\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-59r7c" Jun 03 15:03:28.284433 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.283321 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-default-certificate\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:28.284433 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.283429 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1536eb21-7935-4dc8-8066-9e6d7e6c3ab5-serving-cert\") pod \"insights-operator-788bf58df5-lkk8x\" (UID: \"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5\") " pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.286711 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.286620 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c1d6767-775a-4feb-ab75-d42366001da8-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-vzpss\" (UID: \"6c1d6767-775a-4feb-ab75-d42366001da8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss" Jun 03 15:03:28.291697 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.291663 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9vvs\" (UniqueName: \"kubernetes.io/projected/04be6e74-740f-48d9-a3f6-32f7466b9520-kube-api-access-p9vvs\") pod \"service-ca-operator-69877444c-59r7c\" (UID: \"04be6e74-740f-48d9-a3f6-32f7466b9520\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-59r7c" Jun 03 15:03:28.292194 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.291877 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-bound-sa-token\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.292194 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.291983 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqt4g\" (UniqueName: \"kubernetes.io/projected/466be55f-b28b-4b72-979e-b679d95de62c-kube-api-access-vqt4g\") pod \"dns-default-gbhfn\" (UID: \"466be55f-b28b-4b72-979e-b679d95de62c\") " pod="openshift-dns/dns-default-gbhfn" Jun 03 15:03:28.295004 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.294975 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsh2l\" (UniqueName: \"kubernetes.io/projected/6c1d6767-775a-4feb-ab75-d42366001da8-kube-api-access-qsh2l\") pod \"kube-storage-version-migrator-operator-96ddc787c-vzpss\" (UID: \"6c1d6767-775a-4feb-ab75-d42366001da8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss" Jun 03 15:03:28.295232 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.295209 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vg8k\" (UniqueName: \"kubernetes.io/projected/c6b8dc06-9393-43f8-a071-e7ef74839d86-kube-api-access-5vg8k\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:28.295232 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.295226 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bh5s\" (UniqueName: \"kubernetes.io/projected/a78c9d2a-e01f-42d2-bd99-11ead85f8dde-kube-api-access-9bh5s\") pod \"managed-serviceaccount-addon-agent-64c7c989c4-rp4cx\" (UID: \"a78c9d2a-e01f-42d2-bd99-11ead85f8dde\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c7c989c4-rp4cx" Jun 03 15:03:28.295340 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.295271 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t57qs\" (UniqueName: \"kubernetes.io/projected/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-kube-api-access-t57qs\") pod \"cluster-samples-operator-755bbf9bfb-ndlpw\" (UID: \"e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw" Jun 03 15:03:28.296000 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.295957 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p469j\" (UniqueName: \"kubernetes.io/projected/399fce46-fa37-43a7-b31e-0e5848d3735e-kube-api-access-p469j\") pod \"cluster-monitoring-operator-69b6cbdb88-88whh\" (UID: \"399fce46-fa37-43a7-b31e-0e5848d3735e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" Jun 03 15:03:28.296602 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.296556 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhw6c\" (UniqueName: \"kubernetes.io/projected/aa816b3b-352e-425b-b91e-2a721b0b4f51-kube-api-access-rhw6c\") pod \"network-check-source-56d84b9f44-rdm7h\" (UID: \"aa816b3b-352e-425b-b91e-2a721b0b4f51\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-rdm7h" Jun 03 15:03:28.297452 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.297412 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngfd5\" (UniqueName: \"kubernetes.io/projected/acc4bf03-9c54-471c-a6eb-2dec415170d6-kube-api-access-ngfd5\") pod \"cluster-proxy-proxy-agent-c5d7dcc84-58rn4\" (UID: \"acc4bf03-9c54-471c-a6eb-2dec415170d6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.297553 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.297534 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp4fd\" (UniqueName: \"kubernetes.io/projected/2cf31970-1119-4806-b4e0-0e26a630594a-kube-api-access-cp4fd\") pod \"volume-data-source-validator-7598fd5bd-tmjbd\" (UID: \"2cf31970-1119-4806-b4e0-0e26a630594a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tmjbd" Jun 03 15:03:28.297877 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.297851 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l8md\" (UniqueName: \"kubernetes.io/projected/05144d0b-dd83-4d3c-9b43-4480b3fc8a35-kube-api-access-6l8md\") pod \"console-operator-86d7c6cc77-hskk5\" (UID: \"05144d0b-dd83-4d3c-9b43-4480b3fc8a35\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" Jun 03 15:03:28.298021 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.297953 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpqjd\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-kube-api-access-lpqjd\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.298210 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.298194 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l7ng\" (UniqueName: \"kubernetes.io/projected/1536eb21-7935-4dc8-8066-9e6d7e6c3ab5-kube-api-access-8l7ng\") pod \"insights-operator-788bf58df5-lkk8x\" (UID: \"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5\") " pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.302877 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.302510 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg" Jun 03 15:03:28.322099 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.321947 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tmjbd" Jun 03 15:03:28.340235 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.340205 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-lkk8x" Jun 03 15:03:28.376922 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.376886 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdvdb\" (UniqueName: \"kubernetes.io/projected/747b2535-7bfc-402d-ab7c-b645e8c06569-kube-api-access-jdvdb\") pod \"ingress-canary-wp7ml\" (UID: \"747b2535-7bfc-402d-ab7c-b645e8c06569\") " pod="openshift-ingress-canary/ingress-canary-wp7ml" Jun 03 15:03:28.377112 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.376997 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert\") pod \"ingress-canary-wp7ml\" (UID: \"747b2535-7bfc-402d-ab7c-b645e8c06569\") " pod="openshift-ingress-canary/ingress-canary-wp7ml" Jun 03 15:03:28.377175 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.377126 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:03:28.377225 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.377206 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert podName:747b2535-7bfc-402d-ab7c-b645e8c06569 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:28.87717799 +0000 UTC m=+36.230147998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert") pod "ingress-canary-wp7ml" (UID: "747b2535-7bfc-402d-ab7c-b645e8c06569") : secret "canary-serving-cert" not found Jun 03 15:03:28.382710 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.382674 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" Jun 03 15:03:28.390519 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.390495 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-59r7c" Jun 03 15:03:28.397250 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.397227 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdvdb\" (UniqueName: \"kubernetes.io/projected/747b2535-7bfc-402d-ab7c-b645e8c06569-kube-api-access-jdvdb\") pod \"ingress-canary-wp7ml\" (UID: \"747b2535-7bfc-402d-ab7c-b645e8c06569\") " pod="openshift-ingress-canary/ingress-canary-wp7ml" Jun 03 15:03:28.404855 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.404830 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss" Jun 03 15:03:28.410444 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.410424 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-rdm7h" Jun 03 15:03:28.437413 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.437332 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c7c989c4-rp4cx" Jun 03 15:03:28.443436 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.443413 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:03:28.679575 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.679539 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:28.679749 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.679707 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:03:28.679749 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.679729 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774f88d448-wpp89: secret "image-registry-tls" not found Jun 03 15:03:28.679827 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.679810 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls podName:866c3310-011a-4ab6-b677-93e8eeabd1d6 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:29.679794748 +0000 UTC m=+37.032764751 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls") pod "image-registry-774f88d448-wpp89" (UID: "866c3310-011a-4ab6-b677-93e8eeabd1d6") : secret "image-registry-tls" not found Jun 03 15:03:28.780805 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.780722 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:28.780805 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.780779 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-ndlpw\" (UID: \"e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw" Jun 03 15:03:28.781066 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.780873 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 15:03:28.781066 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.780886 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:03:28.781066 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.780905 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb8d97579-px8fb: secret "image-registry-tls" not found Jun 03 15:03:28.781066 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.780930 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls podName:e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:29.780915872 +0000 UTC m=+37.133885876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-ndlpw" (UID: "e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53") : secret "samples-operator-tls" not found Jun 03 15:03:28.781066 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.780958 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls podName:f5cc1a7b-de22-4984-94d2-a6c717d2acf3 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:29.78093859 +0000 UTC m=+37.133908611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls") pod "image-registry-bb8d97579-px8fb" (UID: "f5cc1a7b-de22-4984-94d2-a6c717d2acf3") : secret "image-registry-tls" not found Jun 03 15:03:28.781066 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.780993 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:28.781318 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.781070 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:28.781318 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.781126 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle podName:c6b8dc06-9393-43f8-a071-e7ef74839d86 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:29.78111346 +0000 UTC m=+37.134083467 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle") pod "router-default-64cd489db9-fdf9z" (UID: "c6b8dc06-9393-43f8-a071-e7ef74839d86") : configmap references non-existent config key: service-ca.crt Jun 03 15:03:28.781318 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.781155 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 15:03:28.781318 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.781186 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs podName:c6b8dc06-9393-43f8-a071-e7ef74839d86 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:29.781177444 +0000 UTC m=+37.134147447 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs") pod "router-default-64cd489db9-fdf9z" (UID: "c6b8dc06-9393-43f8-a071-e7ef74839d86") : secret "router-metrics-certs-default" not found Jun 03 15:03:28.781318 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.781154 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-fdjbh\" (UID: \"3a300de4-981a-4bee-8f25-c25a10a85d29\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh" Jun 03 15:03:28.781318 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.781214 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 15:03:28.781318 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.781219 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls\") pod \"dns-default-gbhfn\" (UID: \"466be55f-b28b-4b72-979e-b679d95de62c\") " pod="openshift-dns/dns-default-gbhfn" Jun 03 15:03:28.781318 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.781246 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert podName:3a300de4-981a-4bee-8f25-c25a10a85d29 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:29.781237028 +0000 UTC m=+37.134207037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-fdjbh" (UID: "3a300de4-981a-4bee-8f25-c25a10a85d29") : secret "networking-console-plugin-cert" not found Jun 03 15:03:28.781318 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.781283 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:03:28.781318 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.781295 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-88whh\" (UID: \"399fce46-fa37-43a7-b31e-0e5848d3735e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" Jun 03 15:03:28.781318 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.781317 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls podName:466be55f-b28b-4b72-979e-b679d95de62c nodeName:}" failed. No retries permitted until 2026-06-03 15:03:29.781305917 +0000 UTC m=+37.134275927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls") pod "dns-default-gbhfn" (UID: "466be55f-b28b-4b72-979e-b679d95de62c") : secret "dns-default-metrics-tls" not found Jun 03 15:03:28.781712 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.781342 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 15:03:28.781712 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.781392 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls podName:399fce46-fa37-43a7-b31e-0e5848d3735e nodeName:}" failed. No retries permitted until 2026-06-03 15:03:29.781379327 +0000 UTC m=+37.134349333 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-88whh" (UID: "399fce46-fa37-43a7-b31e-0e5848d3735e") : secret "cluster-monitoring-operator-tls" not found Jun 03 15:03:28.882118 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:28.882079 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert\") pod \"ingress-canary-wp7ml\" (UID: \"747b2535-7bfc-402d-ab7c-b645e8c06569\") " pod="openshift-ingress-canary/ingress-canary-wp7ml" Jun 03 15:03:28.882302 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.882250 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:03:28.882390 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:28.882323 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert podName:747b2535-7bfc-402d-ab7c-b645e8c06569 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:29.882300908 +0000 UTC m=+37.235270924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert") pod "ingress-canary-wp7ml" (UID: "747b2535-7bfc-402d-ab7c-b645e8c06569") : secret "canary-serving-cert" not found Jun 03 15:03:29.239595 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:29.239560 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:29.240264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:29.239755 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:29.244170 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:29.244124 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 15:03:29.244410 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:29.244390 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6cj8w\"" Jun 03 15:03:29.244505 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:29.244482 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zkmcm\"" Jun 03 15:03:29.689769 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:29.689720 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:29.689921 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.689851 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:03:29.689921 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.689870 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774f88d448-wpp89: secret "image-registry-tls" not found Jun 03 15:03:29.689921 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.689919 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls podName:866c3310-011a-4ab6-b677-93e8eeabd1d6 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:31.68990493 +0000 UTC m=+39.042874934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls") pod "image-registry-774f88d448-wpp89" (UID: "866c3310-011a-4ab6-b677-93e8eeabd1d6") : secret "image-registry-tls" not found Jun 03 15:03:29.790902 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:29.790862 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-fdjbh\" (UID: \"3a300de4-981a-4bee-8f25-c25a10a85d29\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh" Jun 03 15:03:29.791076 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:29.790920 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls\") pod \"dns-default-gbhfn\" (UID: \"466be55f-b28b-4b72-979e-b679d95de62c\") " pod="openshift-dns/dns-default-gbhfn" Jun 03 15:03:29.791076 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:29.790964 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-88whh\" (UID: \"399fce46-fa37-43a7-b31e-0e5848d3735e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" Jun 03 15:03:29.791076 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.791045 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 15:03:29.791076 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:29.791063 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:29.791257 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.791098 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 15:03:29.791257 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.791120 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert podName:3a300de4-981a-4bee-8f25-c25a10a85d29 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:31.791099071 +0000 UTC m=+39.144069109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-fdjbh" (UID: "3a300de4-981a-4bee-8f25-c25a10a85d29") : secret "networking-console-plugin-cert" not found Jun 03 15:03:29.791257 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:29.791147 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-ndlpw\" (UID: \"e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw" Jun 03 15:03:29.791257 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.791156 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:03:29.791257 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.791170 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:03:29.791257 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.791179 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls podName:466be55f-b28b-4b72-979e-b679d95de62c nodeName:}" failed. No retries permitted until 2026-06-03 15:03:31.791168448 +0000 UTC m=+39.144138453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls") pod "dns-default-gbhfn" (UID: "466be55f-b28b-4b72-979e-b679d95de62c") : secret "dns-default-metrics-tls" not found Jun 03 15:03:29.791257 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.791183 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb8d97579-px8fb: secret "image-registry-tls" not found Jun 03 15:03:29.791257 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:29.791219 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:29.791257 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.791224 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls podName:f5cc1a7b-de22-4984-94d2-a6c717d2acf3 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:31.791212089 +0000 UTC m=+39.144182093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls") pod "image-registry-bb8d97579-px8fb" (UID: "f5cc1a7b-de22-4984-94d2-a6c717d2acf3") : secret "image-registry-tls" not found Jun 03 15:03:29.791257 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.791230 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 15:03:29.791257 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.791249 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls podName:399fce46-fa37-43a7-b31e-0e5848d3735e nodeName:}" failed. No retries permitted until 2026-06-03 15:03:31.791236987 +0000 UTC m=+39.144206996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-88whh" (UID: "399fce46-fa37-43a7-b31e-0e5848d3735e") : secret "cluster-monitoring-operator-tls" not found Jun 03 15:03:29.791823 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.791270 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls podName:e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:31.791259397 +0000 UTC m=+39.144229419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-ndlpw" (UID: "e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53") : secret "samples-operator-tls" not found Jun 03 15:03:29.791823 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:29.791314 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:29.791823 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.791329 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle podName:c6b8dc06-9393-43f8-a071-e7ef74839d86 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:31.79131612 +0000 UTC m=+39.144286138 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle") pod "router-default-64cd489db9-fdf9z" (UID: "c6b8dc06-9393-43f8-a071-e7ef74839d86") : configmap references non-existent config key: service-ca.crt Jun 03 15:03:29.791823 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.791388 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 15:03:29.791823 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.791424 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs podName:c6b8dc06-9393-43f8-a071-e7ef74839d86 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:31.791413347 +0000 UTC m=+39.144383387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs") pod "router-default-64cd489db9-fdf9z" (UID: "c6b8dc06-9393-43f8-a071-e7ef74839d86") : secret "router-metrics-certs-default" not found Jun 03 15:03:29.892466 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:29.892433 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert\") pod \"ingress-canary-wp7ml\" (UID: \"747b2535-7bfc-402d-ab7c-b645e8c06569\") " pod="openshift-ingress-canary/ingress-canary-wp7ml" Jun 03 15:03:29.892631 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.892588 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:03:29.892688 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:29.892645 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert podName:747b2535-7bfc-402d-ab7c-b645e8c06569 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:31.8926315 +0000 UTC m=+39.245601509 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert") pod "ingress-canary-wp7ml" (UID: "747b2535-7bfc-402d-ab7c-b645e8c06569") : secret "canary-serving-cert" not found Jun 03 15:03:30.574117 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:30.573897 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-59r7c"] Jun 03 15:03:30.587670 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:30.587648 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-hskk5"] Jun 03 15:03:30.593535 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:30.593515 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-lkk8x"] Jun 03 15:03:30.598281 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:30.598265 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tmjbd"] Jun 03 15:03:30.607613 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:30.607584 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c7c989c4-rp4cx"] Jun 03 15:03:30.610253 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:30.609714 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-rdm7h"] Jun 03 15:03:30.611094 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:30.611072 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss"] Jun 03 15:03:30.612308 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:30.612291 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4"] Jun 03 15:03:30.613093 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:30.613065 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg"] Jun 03 15:03:30.629900 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:03:30.629873 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04be6e74_740f_48d9_a3f6_32f7466b9520.slice/crio-92d9bdf939bf8724c1921597c74f08eff1f9c119fdfef4df59104441f4b5fe4f WatchSource:0}: Error finding container 92d9bdf939bf8724c1921597c74f08eff1f9c119fdfef4df59104441f4b5fe4f: Status 404 returned error can't find the container with id 92d9bdf939bf8724c1921597c74f08eff1f9c119fdfef4df59104441f4b5fe4f Jun 03 15:03:30.630817 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:03:30.630798 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05144d0b_dd83_4d3c_9b43_4480b3fc8a35.slice/crio-69d53e98c397f78dd016ee6e9b57dbb134c0e7470a885da6be6e80b57751c54d WatchSource:0}: Error finding container 69d53e98c397f78dd016ee6e9b57dbb134c0e7470a885da6be6e80b57751c54d: Status 404 returned error can't find the container with id 69d53e98c397f78dd016ee6e9b57dbb134c0e7470a885da6be6e80b57751c54d Jun 03 15:03:30.631299 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:03:30.631276 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1536eb21_7935_4dc8_8066_9e6d7e6c3ab5.slice/crio-68091af9f16a7ea4fe63b1baf3606cd8113a3462e518a1f087d9ec2e267402fc WatchSource:0}: Error finding container 68091af9f16a7ea4fe63b1baf3606cd8113a3462e518a1f087d9ec2e267402fc: Status 404 returned error can't find the container with id 68091af9f16a7ea4fe63b1baf3606cd8113a3462e518a1f087d9ec2e267402fc Jun 03 15:03:30.632258 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:03:30.632156 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf31970_1119_4806_b4e0_0e26a630594a.slice/crio-5c20c2f4042dd021a850f64df6f85b6f38894335d8b9279c80af2968297a95e4 WatchSource:0}: Error finding container 5c20c2f4042dd021a850f64df6f85b6f38894335d8b9279c80af2968297a95e4: Status 404 returned error can't find the container with id 5c20c2f4042dd021a850f64df6f85b6f38894335d8b9279c80af2968297a95e4 Jun 03 15:03:30.633508 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:03:30.633385 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa816b3b_352e_425b_b91e_2a721b0b4f51.slice/crio-4f523fb0cbb73bf300d7666d28a278bb200f3bfdbf868d310731adf79b19c5ca WatchSource:0}: Error finding container 4f523fb0cbb73bf300d7666d28a278bb200f3bfdbf868d310731adf79b19c5ca: Status 404 returned error can't find the container with id 4f523fb0cbb73bf300d7666d28a278bb200f3bfdbf868d310731adf79b19c5ca Jun 03 15:03:30.633998 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:03:30.633923 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda78c9d2a_e01f_42d2_bd99_11ead85f8dde.slice/crio-a1d4dc75528d061a650cd5d86c000daa938c1c5ae5fccd80b080af614622680c WatchSource:0}: Error finding container a1d4dc75528d061a650cd5d86c000daa938c1c5ae5fccd80b080af614622680c: Status 404 returned error can't find the container with id a1d4dc75528d061a650cd5d86c000daa938c1c5ae5fccd80b080af614622680c Jun 03 15:03:30.635080 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:03:30.634910 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c1d6767_775a_4feb_ab75_d42366001da8.slice/crio-4d08a19e32abfca8eb0bbab8b16801d81cca5b4ba9516c70dc92793cfcd494fd WatchSource:0}: Error finding container 4d08a19e32abfca8eb0bbab8b16801d81cca5b4ba9516c70dc92793cfcd494fd: Status 404 returned error can't find the container with id 4d08a19e32abfca8eb0bbab8b16801d81cca5b4ba9516c70dc92793cfcd494fd Jun 03 15:03:30.636128 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:03:30.635903 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a494f74_e51e_4ac2_8e9f_d063147ae467.slice/crio-607e8eb53adc20604bf3ef717cbc159f59533a5236d341365ec841331433ea06 WatchSource:0}: Error finding container 607e8eb53adc20604bf3ef717cbc159f59533a5236d341365ec841331433ea06: Status 404 returned error can't find the container with id 607e8eb53adc20604bf3ef717cbc159f59533a5236d341365ec841331433ea06 Jun 03 15:03:30.636565 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:03:30.636531 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacc4bf03_9c54_471c_a6eb_2dec415170d6.slice/crio-5eca4ca5b8bf193fa2c8082ca072c030b4a0a5a77d2e5ca4f63558915edc4cf2 WatchSource:0}: Error finding container 5eca4ca5b8bf193fa2c8082ca072c030b4a0a5a77d2e5ca4f63558915edc4cf2: Status 404 returned error can't find the container with id 5eca4ca5b8bf193fa2c8082ca072c030b4a0a5a77d2e5ca4f63558915edc4cf2 Jun 03 15:03:31.408913 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.408878 2577 generic.go:358] "Generic (PLEG): container finished" podID="efd0c5f0-905f-486d-9f9c-f8ed997b2c9b" containerID="9cfa04e451f0fba6b85c9aa840f72024ed25bae27bba36f55dce32577b351daf" exitCode=0 Jun 03 15:03:31.409080 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.408982 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xm4dj" event={"ID":"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b","Type":"ContainerDied","Data":"9cfa04e451f0fba6b85c9aa840f72024ed25bae27bba36f55dce32577b351daf"} Jun 03 15:03:31.410464 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.410334 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c7c989c4-rp4cx" event={"ID":"a78c9d2a-e01f-42d2-bd99-11ead85f8dde","Type":"ContainerStarted","Data":"a1d4dc75528d061a650cd5d86c000daa938c1c5ae5fccd80b080af614622680c"} Jun 03 15:03:31.411687 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.411661 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-59r7c" event={"ID":"04be6e74-740f-48d9-a3f6-32f7466b9520","Type":"ContainerStarted","Data":"92d9bdf939bf8724c1921597c74f08eff1f9c119fdfef4df59104441f4b5fe4f"} Jun 03 15:03:31.413081 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.413054 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tmjbd" event={"ID":"2cf31970-1119-4806-b4e0-0e26a630594a","Type":"ContainerStarted","Data":"5c20c2f4042dd021a850f64df6f85b6f38894335d8b9279c80af2968297a95e4"} Jun 03 15:03:31.414254 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.414155 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" event={"ID":"05144d0b-dd83-4d3c-9b43-4480b3fc8a35","Type":"ContainerStarted","Data":"69d53e98c397f78dd016ee6e9b57dbb134c0e7470a885da6be6e80b57751c54d"} Jun 03 15:03:31.415464 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.415427 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss" event={"ID":"6c1d6767-775a-4feb-ab75-d42366001da8","Type":"ContainerStarted","Data":"4d08a19e32abfca8eb0bbab8b16801d81cca5b4ba9516c70dc92793cfcd494fd"} Jun 03 15:03:31.416894 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.416870 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg" event={"ID":"3a494f74-e51e-4ac2-8e9f-d063147ae467","Type":"ContainerStarted","Data":"607e8eb53adc20604bf3ef717cbc159f59533a5236d341365ec841331433ea06"} Jun 03 15:03:31.418311 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.418280 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-rdm7h" event={"ID":"aa816b3b-352e-425b-b91e-2a721b0b4f51","Type":"ContainerStarted","Data":"4f523fb0cbb73bf300d7666d28a278bb200f3bfdbf868d310731adf79b19c5ca"} Jun 03 15:03:31.419447 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.419424 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-lkk8x" event={"ID":"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5","Type":"ContainerStarted","Data":"68091af9f16a7ea4fe63b1baf3606cd8113a3462e518a1f087d9ec2e267402fc"} Jun 03 15:03:31.420587 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.420554 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" event={"ID":"acc4bf03-9c54-471c-a6eb-2dec415170d6","Type":"ContainerStarted","Data":"5eca4ca5b8bf193fa2c8082ca072c030b4a0a5a77d2e5ca4f63558915edc4cf2"} Jun 03 15:03:31.709261 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.708822 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:31.709261 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.709150 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:03:31.709261 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.709177 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774f88d448-wpp89: secret "image-registry-tls" not found Jun 03 15:03:31.709261 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.709236 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls podName:866c3310-011a-4ab6-b677-93e8eeabd1d6 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:35.709216308 +0000 UTC m=+43.062186320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls") pod "image-registry-774f88d448-wpp89" (UID: "866c3310-011a-4ab6-b677-93e8eeabd1d6") : secret "image-registry-tls" not found Jun 03 15:03:31.810165 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.810059 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:31.810803 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.810583 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:03:31.810803 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.810604 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb8d97579-px8fb: secret "image-registry-tls" not found Jun 03 15:03:31.810803 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.810530 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 15:03:31.811594 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.811137 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls podName:e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:35.810681757 +0000 UTC m=+43.163651785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-ndlpw" (UID: "e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53") : secret "samples-operator-tls" not found Jun 03 15:03:31.811594 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.811173 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls podName:f5cc1a7b-de22-4984-94d2-a6c717d2acf3 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:35.811159482 +0000 UTC m=+43.164129493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls") pod "image-registry-bb8d97579-px8fb" (UID: "f5cc1a7b-de22-4984-94d2-a6c717d2acf3") : secret "image-registry-tls" not found Jun 03 15:03:31.812390 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.811745 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-ndlpw\" (UID: \"e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw" Jun 03 15:03:31.812390 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.811839 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:31.812390 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.811892 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:31.812390 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.811955 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-fdjbh\" (UID: \"3a300de4-981a-4bee-8f25-c25a10a85d29\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh" Jun 03 15:03:31.812390 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.811988 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls\") pod \"dns-default-gbhfn\" (UID: \"466be55f-b28b-4b72-979e-b679d95de62c\") " pod="openshift-dns/dns-default-gbhfn" Jun 03 15:03:31.812390 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.812032 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-88whh\" (UID: \"399fce46-fa37-43a7-b31e-0e5848d3735e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" Jun 03 15:03:31.812390 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.812237 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 15:03:31.812390 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.812279 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle podName:c6b8dc06-9393-43f8-a071-e7ef74839d86 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:35.812259376 +0000 UTC m=+43.165229395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle") pod "router-default-64cd489db9-fdf9z" (UID: "c6b8dc06-9393-43f8-a071-e7ef74839d86") : configmap references non-existent config key: service-ca.crt Jun 03 15:03:31.812390 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.812306 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs podName:c6b8dc06-9393-43f8-a071-e7ef74839d86 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:35.812296776 +0000 UTC m=+43.165266785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs") pod "router-default-64cd489db9-fdf9z" (UID: "c6b8dc06-9393-43f8-a071-e7ef74839d86") : secret "router-metrics-certs-default" not found Jun 03 15:03:31.812390 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.812315 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 15:03:31.812390 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.812353 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert podName:3a300de4-981a-4bee-8f25-c25a10a85d29 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:35.812336806 +0000 UTC m=+43.165306825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-fdjbh" (UID: "3a300de4-981a-4bee-8f25-c25a10a85d29") : secret "networking-console-plugin-cert" not found Jun 03 15:03:31.812959 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.812399 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:03:31.812959 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.812442 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls podName:466be55f-b28b-4b72-979e-b679d95de62c nodeName:}" failed. No retries permitted until 2026-06-03 15:03:35.812431523 +0000 UTC m=+43.165401534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls") pod "dns-default-gbhfn" (UID: "466be55f-b28b-4b72-979e-b679d95de62c") : secret "dns-default-metrics-tls" not found Jun 03 15:03:31.813389 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.813280 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 15:03:31.813389 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.813349 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls podName:399fce46-fa37-43a7-b31e-0e5848d3735e nodeName:}" failed. No retries permitted until 2026-06-03 15:03:35.813335005 +0000 UTC m=+43.166305023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-88whh" (UID: "399fce46-fa37-43a7-b31e-0e5848d3735e") : secret "cluster-monitoring-operator-tls" not found Jun 03 15:03:31.912912 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:31.912840 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert\") pod \"ingress-canary-wp7ml\" (UID: \"747b2535-7bfc-402d-ab7c-b645e8c06569\") " pod="openshift-ingress-canary/ingress-canary-wp7ml" Jun 03 15:03:31.913067 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.913050 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:03:31.913140 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:31.913105 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert podName:747b2535-7bfc-402d-ab7c-b645e8c06569 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:35.913087516 +0000 UTC m=+43.266057534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert") pod "ingress-canary-wp7ml" (UID: "747b2535-7bfc-402d-ab7c-b645e8c06569") : secret "canary-serving-cert" not found Jun 03 15:03:32.454325 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:32.454034 2577 generic.go:358] "Generic (PLEG): container finished" podID="efd0c5f0-905f-486d-9f9c-f8ed997b2c9b" containerID="7f39c973621edde7a157ad290fe84891e39359de876c256d800ba7cba56b2145" exitCode=0 Jun 03 15:03:32.454325 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:32.454114 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xm4dj" event={"ID":"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b","Type":"ContainerDied","Data":"7f39c973621edde7a157ad290fe84891e39359de876c256d800ba7cba56b2145"} Jun 03 15:03:33.522879 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:33.522324 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xm4dj" event={"ID":"efd0c5f0-905f-486d-9f9c-f8ed997b2c9b","Type":"ContainerStarted","Data":"12745df9f2460e8b3853ee7adcfffe253ca609305eccff58d60499665891572b"} Jun 03 15:03:35.759180 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:35.759137 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:35.759662 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.759326 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:03:35.759662 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.759353 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774f88d448-wpp89: secret "image-registry-tls" not found Jun 03 15:03:35.759662 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.759452 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls podName:866c3310-011a-4ab6-b677-93e8eeabd1d6 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:43.75942966 +0000 UTC m=+51.112399679 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls") pod "image-registry-774f88d448-wpp89" (UID: "866c3310-011a-4ab6-b677-93e8eeabd1d6") : secret "image-registry-tls" not found Jun 03 15:03:35.860092 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:35.860050 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:35.860273 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:35.860105 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-ndlpw\" (UID: \"e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw" Jun 03 15:03:35.860273 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:35.860152 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:35.860273 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:35.860198 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:35.860273 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:35.860241 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-fdjbh\" (UID: \"3a300de4-981a-4bee-8f25-c25a10a85d29\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh" Jun 03 15:03:35.860273 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.860245 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:03:35.860273 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.860267 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb8d97579-px8fb: secret "image-registry-tls" not found Jun 03 15:03:35.860273 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:35.860272 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls\") pod \"dns-default-gbhfn\" (UID: \"466be55f-b28b-4b72-979e-b679d95de62c\") " pod="openshift-dns/dns-default-gbhfn" Jun 03 15:03:35.860612 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.860289 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 15:03:35.860612 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:35.860319 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-88whh\" (UID: \"399fce46-fa37-43a7-b31e-0e5848d3735e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" Jun 03 15:03:35.860612 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.860353 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls podName:e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:43.860333576 +0000 UTC m=+51.213303892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-ndlpw" (UID: "e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53") : secret "samples-operator-tls" not found Jun 03 15:03:35.860612 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.860357 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 15:03:35.860612 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.860407 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 15:03:35.860612 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.860414 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:03:35.860612 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.860420 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 15:03:35.860612 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.860449 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls podName:f5cc1a7b-de22-4984-94d2-a6c717d2acf3 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:43.860430088 +0000 UTC m=+51.213400100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls") pod "image-registry-bb8d97579-px8fb" (UID: "f5cc1a7b-de22-4984-94d2-a6c717d2acf3") : secret "image-registry-tls" not found Jun 03 15:03:35.860612 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.860471 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle podName:c6b8dc06-9393-43f8-a071-e7ef74839d86 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:43.860461289 +0000 UTC m=+51.213431308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle") pod "router-default-64cd489db9-fdf9z" (UID: "c6b8dc06-9393-43f8-a071-e7ef74839d86") : configmap references non-existent config key: service-ca.crt Jun 03 15:03:35.860612 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.860489 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs podName:c6b8dc06-9393-43f8-a071-e7ef74839d86 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:43.860480905 +0000 UTC m=+51.213450911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs") pod "router-default-64cd489db9-fdf9z" (UID: "c6b8dc06-9393-43f8-a071-e7ef74839d86") : secret "router-metrics-certs-default" not found Jun 03 15:03:35.860612 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.860546 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls podName:466be55f-b28b-4b72-979e-b679d95de62c nodeName:}" failed. No retries permitted until 2026-06-03 15:03:43.860536558 +0000 UTC m=+51.213506563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls") pod "dns-default-gbhfn" (UID: "466be55f-b28b-4b72-979e-b679d95de62c") : secret "dns-default-metrics-tls" not found Jun 03 15:03:35.860612 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.860562 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls podName:399fce46-fa37-43a7-b31e-0e5848d3735e nodeName:}" failed. No retries permitted until 2026-06-03 15:03:43.860554133 +0000 UTC m=+51.213524141 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-88whh" (UID: "399fce46-fa37-43a7-b31e-0e5848d3735e") : secret "cluster-monitoring-operator-tls" not found Jun 03 15:03:35.860612 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.860576 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert podName:3a300de4-981a-4bee-8f25-c25a10a85d29 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:43.860569288 +0000 UTC m=+51.213539292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-fdjbh" (UID: "3a300de4-981a-4bee-8f25-c25a10a85d29") : secret "networking-console-plugin-cert" not found Jun 03 15:03:35.960926 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:35.960894 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert\") pod \"ingress-canary-wp7ml\" (UID: \"747b2535-7bfc-402d-ab7c-b645e8c06569\") " pod="openshift-ingress-canary/ingress-canary-wp7ml" Jun 03 15:03:35.961081 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.961063 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:03:35.961142 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:35.961128 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert podName:747b2535-7bfc-402d-ab7c-b645e8c06569 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:43.961108548 +0000 UTC m=+51.314078559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert") pod "ingress-canary-wp7ml" (UID: "747b2535-7bfc-402d-ab7c-b645e8c06569") : secret "canary-serving-cert" not found Jun 03 15:03:37.101392 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:37.101330 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xm4dj" podStartSLOduration=9.368914877 podStartE2EDuration="44.101314505s" podCreationTimestamp="2026-06-03 15:02:53 +0000 UTC" firstStartedPulling="2026-06-03 15:02:55.952318657 +0000 UTC m=+3.305288661" lastFinishedPulling="2026-06-03 15:03:30.684718282 +0000 UTC m=+38.037688289" observedRunningTime="2026-06-03 15:03:33.687586276 +0000 UTC m=+41.040556303" watchObservedRunningTime="2026-06-03 15:03:37.101314505 +0000 UTC m=+44.454284568" Jun 03 15:03:37.101776 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:37.101574 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-d6kcq"] Jun 03 15:03:37.127090 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:37.127064 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6kcq" Jun 03 15:03:37.133233 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:37.133209 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 15:03:37.173606 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:37.173572 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4a0def35-868d-4101-9dc2-c4f9f817ac49-kubelet-config\") pod \"global-pull-secret-syncer-d6kcq\" (UID: \"4a0def35-868d-4101-9dc2-c4f9f817ac49\") " pod="kube-system/global-pull-secret-syncer-d6kcq" Jun 03 15:03:37.173791 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:37.173771 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4a0def35-868d-4101-9dc2-c4f9f817ac49-dbus\") pod \"global-pull-secret-syncer-d6kcq\" (UID: \"4a0def35-868d-4101-9dc2-c4f9f817ac49\") " pod="kube-system/global-pull-secret-syncer-d6kcq" Jun 03 15:03:37.173872 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:37.173821 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0def35-868d-4101-9dc2-c4f9f817ac49-original-pull-secret\") pod \"global-pull-secret-syncer-d6kcq\" (UID: \"4a0def35-868d-4101-9dc2-c4f9f817ac49\") " pod="kube-system/global-pull-secret-syncer-d6kcq" Jun 03 15:03:37.205571 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:37.205539 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d6kcq"] Jun 03 15:03:37.274384 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:37.274324 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4a0def35-868d-4101-9dc2-c4f9f817ac49-kubelet-config\") pod \"global-pull-secret-syncer-d6kcq\" (UID: \"4a0def35-868d-4101-9dc2-c4f9f817ac49\") " pod="kube-system/global-pull-secret-syncer-d6kcq" Jun 03 15:03:37.274525 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:37.274456 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4a0def35-868d-4101-9dc2-c4f9f817ac49-kubelet-config\") pod \"global-pull-secret-syncer-d6kcq\" (UID: \"4a0def35-868d-4101-9dc2-c4f9f817ac49\") " pod="kube-system/global-pull-secret-syncer-d6kcq" Jun 03 15:03:37.274603 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:37.274519 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4a0def35-868d-4101-9dc2-c4f9f817ac49-dbus\") pod \"global-pull-secret-syncer-d6kcq\" (UID: \"4a0def35-868d-4101-9dc2-c4f9f817ac49\") " pod="kube-system/global-pull-secret-syncer-d6kcq" Jun 03 15:03:37.274603 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:37.274579 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0def35-868d-4101-9dc2-c4f9f817ac49-original-pull-secret\") pod \"global-pull-secret-syncer-d6kcq\" (UID: \"4a0def35-868d-4101-9dc2-c4f9f817ac49\") " pod="kube-system/global-pull-secret-syncer-d6kcq" Jun 03 15:03:37.274794 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:37.274767 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4a0def35-868d-4101-9dc2-c4f9f817ac49-dbus\") pod \"global-pull-secret-syncer-d6kcq\" (UID: \"4a0def35-868d-4101-9dc2-c4f9f817ac49\") " pod="kube-system/global-pull-secret-syncer-d6kcq" Jun 03 15:03:37.278865 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:37.278843 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0def35-868d-4101-9dc2-c4f9f817ac49-original-pull-secret\") pod \"global-pull-secret-syncer-d6kcq\" (UID: \"4a0def35-868d-4101-9dc2-c4f9f817ac49\") " pod="kube-system/global-pull-secret-syncer-d6kcq" Jun 03 15:03:37.437988 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:37.437907 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d6kcq" Jun 03 15:03:43.846419 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:43.846383 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:43.846802 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:43.846532 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:03:43.846802 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:43.846551 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774f88d448-wpp89: secret "image-registry-tls" not found Jun 03 15:03:43.846802 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:43.846604 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls podName:866c3310-011a-4ab6-b677-93e8eeabd1d6 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:59.846590032 +0000 UTC m=+67.199560036 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls") pod "image-registry-774f88d448-wpp89" (UID: "866c3310-011a-4ab6-b677-93e8eeabd1d6") : secret "image-registry-tls" not found Jun 03 15:03:43.947469 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:43.947438 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:03:43.947599 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:43.947473 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-ndlpw\" (UID: \"e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw" Jun 03 15:03:43.947599 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:43.947504 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:43.947599 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:43.947572 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:03:43.947709 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:43.947622 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-fdjbh\" (UID: \"3a300de4-981a-4bee-8f25-c25a10a85d29\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh" Jun 03 15:03:43.947709 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:43.947577 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 15:03:43.947709 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:43.947655 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb8d97579-px8fb: secret "image-registry-tls" not found Jun 03 15:03:43.947709 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:43.947645 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls\") pod \"dns-default-gbhfn\" (UID: \"466be55f-b28b-4b72-979e-b679d95de62c\") " pod="openshift-dns/dns-default-gbhfn" Jun 03 15:03:43.947709 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:43.947671 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle podName:c6b8dc06-9393-43f8-a071-e7ef74839d86 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:59.947652292 +0000 UTC m=+67.300622311 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle") pod "router-default-64cd489db9-fdf9z" (UID: "c6b8dc06-9393-43f8-a071-e7ef74839d86") : configmap references non-existent config key: service-ca.crt Jun 03 15:03:43.947709 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:43.947582 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 15:03:43.947709 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:43.947699 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 15:03:43.947709 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:43.947700 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 15:03:43.947977 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:43.947635 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 15:03:43.947977 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:43.947704 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls podName:f5cc1a7b-de22-4984-94d2-a6c717d2acf3 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:59.947692081 +0000 UTC m=+67.300662085 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls") pod "image-registry-bb8d97579-px8fb" (UID: "f5cc1a7b-de22-4984-94d2-a6c717d2acf3") : secret "image-registry-tls" not found Jun 03 15:03:43.947977 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:43.947778 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls podName:466be55f-b28b-4b72-979e-b679d95de62c nodeName:}" failed. No retries permitted until 2026-06-03 15:03:59.947764275 +0000 UTC m=+67.300734282 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls") pod "dns-default-gbhfn" (UID: "466be55f-b28b-4b72-979e-b679d95de62c") : secret "dns-default-metrics-tls" not found Jun 03 15:03:43.947977 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:43.947791 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls podName:e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:59.947784942 +0000 UTC m=+67.300754946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-ndlpw" (UID: "e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53") : secret "samples-operator-tls" not found Jun 03 15:03:43.947977 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:43.947807 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert podName:3a300de4-981a-4bee-8f25-c25a10a85d29 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:59.94780218 +0000 UTC m=+67.300772184 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-fdjbh" (UID: "3a300de4-981a-4bee-8f25-c25a10a85d29") : secret "networking-console-plugin-cert" not found Jun 03 15:03:43.947977 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:43.947822 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs podName:c6b8dc06-9393-43f8-a071-e7ef74839d86 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:59.947817498 +0000 UTC m=+67.300787501 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs") pod "router-default-64cd489db9-fdf9z" (UID: "c6b8dc06-9393-43f8-a071-e7ef74839d86") : secret "router-metrics-certs-default" not found Jun 03 15:03:43.947977 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:43.947860 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-88whh\" (UID: \"399fce46-fa37-43a7-b31e-0e5848d3735e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" Jun 03 15:03:43.947977 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:43.947940 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 15:03:43.947977 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:43.947965 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls podName:399fce46-fa37-43a7-b31e-0e5848d3735e nodeName:}" failed. No retries permitted until 2026-06-03 15:03:59.947958903 +0000 UTC m=+67.300928906 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-88whh" (UID: "399fce46-fa37-43a7-b31e-0e5848d3735e") : secret "cluster-monitoring-operator-tls" not found Jun 03 15:03:44.048923 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:44.048894 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert\") pod \"ingress-canary-wp7ml\" (UID: \"747b2535-7bfc-402d-ab7c-b645e8c06569\") " pod="openshift-ingress-canary/ingress-canary-wp7ml" Jun 03 15:03:44.049094 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:44.049032 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 15:03:44.049181 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:44.049100 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert podName:747b2535-7bfc-402d-ab7c-b645e8c06569 nodeName:}" failed. No retries permitted until 2026-06-03 15:04:00.049082851 +0000 UTC m=+67.402052870 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert") pod "ingress-canary-wp7ml" (UID: "747b2535-7bfc-402d-ab7c-b645e8c06569") : secret "canary-serving-cert" not found Jun 03 15:03:44.532995 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:44.532957 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d6kcq"] Jun 03 15:03:44.540008 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:03:44.539979 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a0def35_868d_4101_9dc2_c4f9f817ac49.slice/crio-1bf7bacc515b30c6221ed61450caafe9be611e68d7ac522303826536de76dfd1 WatchSource:0}: Error finding container 1bf7bacc515b30c6221ed61450caafe9be611e68d7ac522303826536de76dfd1: Status 404 returned error can't find the container with id 1bf7bacc515b30c6221ed61450caafe9be611e68d7ac522303826536de76dfd1 Jun 03 15:03:44.552959 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:44.552927 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d6kcq" event={"ID":"4a0def35-868d-4101-9dc2-c4f9f817ac49","Type":"ContainerStarted","Data":"1bf7bacc515b30c6221ed61450caafe9be611e68d7ac522303826536de76dfd1"} Jun 03 15:03:44.555435 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:44.555165 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tmjbd" event={"ID":"2cf31970-1119-4806-b4e0-0e26a630594a","Type":"ContainerStarted","Data":"0333cf46eef6522005e292d83e0c5e2295a9a039ff5e7b06f16e133dba3f0fee"} Jun 03 15:03:44.557085 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:44.557063 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" event={"ID":"05144d0b-dd83-4d3c-9b43-4480b3fc8a35","Type":"ContainerStarted","Data":"c1699572d1544018d99da19e50bad80890db15f24d3fd6ac41a2b0705353fbe3"} Jun 03 15:03:44.561788 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:44.561760 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss" event={"ID":"6c1d6767-775a-4feb-ab75-d42366001da8","Type":"ContainerStarted","Data":"d78d4b5feb11cd4c969bb4eec24ac212b590a2fc8e3293f5796903138a82140f"} Jun 03 15:03:44.604091 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:44.604035 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss" podStartSLOduration=25.018742458 podStartE2EDuration="38.604014217s" podCreationTimestamp="2026-06-03 15:03:06 +0000 UTC" firstStartedPulling="2026-06-03 15:03:30.661617431 +0000 UTC m=+38.014587453" lastFinishedPulling="2026-06-03 15:03:44.246889204 +0000 UTC m=+51.599859212" observedRunningTime="2026-06-03 15:03:44.604003808 +0000 UTC m=+51.956973836" watchObservedRunningTime="2026-06-03 15:03:44.604014217 +0000 UTC m=+51.956984246" Jun 03 15:03:45.570850 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:45.570800 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" event={"ID":"acc4bf03-9c54-471c-a6eb-2dec415170d6","Type":"ContainerStarted","Data":"420327710d6d67e1b26735d04ee23ee01a4054a5ed2fa7f86a7e761bd4bed50c"} Jun 03 15:03:45.573764 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:45.573051 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c7c989c4-rp4cx" event={"ID":"a78c9d2a-e01f-42d2-bd99-11ead85f8dde","Type":"ContainerStarted","Data":"be64aec47b571e28f7003ad24213ca9db2218a358e0b0a1b87292d144fcea504"} Jun 03 15:03:45.576240 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:45.575836 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-59r7c" event={"ID":"04be6e74-740f-48d9-a3f6-32f7466b9520","Type":"ContainerStarted","Data":"ac27aca1270aa3bd91137e6d96a82b04cf4a753e0dce38fe98ba950b6f987d0c"} Jun 03 15:03:45.578276 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:45.577817 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hskk5_05144d0b-dd83-4d3c-9b43-4480b3fc8a35/console-operator/0.log" Jun 03 15:03:45.578276 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:45.577849 2577 generic.go:358] "Generic (PLEG): container finished" podID="05144d0b-dd83-4d3c-9b43-4480b3fc8a35" containerID="c1699572d1544018d99da19e50bad80890db15f24d3fd6ac41a2b0705353fbe3" exitCode=255 Jun 03 15:03:45.578276 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:45.577907 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" event={"ID":"05144d0b-dd83-4d3c-9b43-4480b3fc8a35","Type":"ContainerDied","Data":"c1699572d1544018d99da19e50bad80890db15f24d3fd6ac41a2b0705353fbe3"} Jun 03 15:03:45.578860 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:45.578592 2577 scope.go:117] "RemoveContainer" containerID="c1699572d1544018d99da19e50bad80890db15f24d3fd6ac41a2b0705353fbe3" Jun 03 15:03:45.582390 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:45.582047 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg" event={"ID":"3a494f74-e51e-4ac2-8e9f-d063147ae467","Type":"ContainerStarted","Data":"4fef7c93db9e3389bd74580731a87b38937eccecd42556ad1c48e93726e949f3"} Jun 03 15:03:45.582785 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:45.582715 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg" Jun 03 15:03:45.584485 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:45.584451 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg" Jun 03 15:03:45.585605 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:45.585027 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-rdm7h" event={"ID":"aa816b3b-352e-425b-b91e-2a721b0b4f51","Type":"ContainerStarted","Data":"9d3768f752e39380dd2d6cab2f3e5633549183700c51f3055f7d1c7012ee49c2"} Jun 03 15:03:45.587674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:45.587559 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-lkk8x" event={"ID":"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5","Type":"ContainerStarted","Data":"68e8b81330267b7f0acc979bb769323dc3b5efac0c1a20ffb4b4805f3346efd9"} Jun 03 15:03:45.609348 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:45.609294 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64c7c989c4-rp4cx" podStartSLOduration=33.897947627 podStartE2EDuration="47.609278657s" podCreationTimestamp="2026-06-03 15:02:58 +0000 UTC" firstStartedPulling="2026-06-03 15:03:30.66159164 +0000 UTC m=+38.014561648" lastFinishedPulling="2026-06-03 15:03:44.372922659 +0000 UTC m=+51.725892678" observedRunningTime="2026-06-03 15:03:45.607317541 +0000 UTC m=+52.960287570" watchObservedRunningTime="2026-06-03 15:03:45.609278657 +0000 UTC m=+52.962248692" Jun 03 15:03:45.735084 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:45.734224 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-lkk8x" podStartSLOduration=25.996932095 podStartE2EDuration="39.734204255s" podCreationTimestamp="2026-06-03 15:03:06 +0000 UTC" firstStartedPulling="2026-06-03 15:03:30.633667279 +0000 UTC m=+37.986637286" lastFinishedPulling="2026-06-03 15:03:44.370939431 +0000 UTC m=+51.723909446" observedRunningTime="2026-06-03 15:03:45.649003629 +0000 UTC m=+53.001973656" watchObservedRunningTime="2026-06-03 15:03:45.734204255 +0000 UTC m=+53.087174282" Jun 03 15:03:45.849136 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:45.848698 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-59r7c" podStartSLOduration=26.10720027 podStartE2EDuration="39.848678816s" podCreationTimestamp="2026-06-03 15:03:06 +0000 UTC" firstStartedPulling="2026-06-03 15:03:30.63222228 +0000 UTC m=+37.985192285" lastFinishedPulling="2026-06-03 15:03:44.373700816 +0000 UTC m=+51.726670831" observedRunningTime="2026-06-03 15:03:45.835416454 +0000 UTC m=+53.188386481" watchObservedRunningTime="2026-06-03 15:03:45.848678816 +0000 UTC m=+53.201648843" Jun 03 15:03:46.040742 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.040685 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-rdm7h" podStartSLOduration=26.301918168 podStartE2EDuration="40.040666181s" podCreationTimestamp="2026-06-03 15:03:06 +0000 UTC" firstStartedPulling="2026-06-03 15:03:30.6350503 +0000 UTC m=+37.988020304" lastFinishedPulling="2026-06-03 15:03:44.373798299 +0000 UTC m=+51.726768317" observedRunningTime="2026-06-03 15:03:46.039159674 +0000 UTC m=+53.392129700" watchObservedRunningTime="2026-06-03 15:03:46.040666181 +0000 UTC m=+53.393636208" Jun 03 15:03:46.243832 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.243545 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tmjbd" podStartSLOduration=26.631903513 podStartE2EDuration="40.243528478s" podCreationTimestamp="2026-06-03 15:03:06 +0000 UTC" firstStartedPulling="2026-06-03 15:03:30.635227481 +0000 UTC m=+37.988197497" lastFinishedPulling="2026-06-03 15:03:44.246852443 +0000 UTC m=+51.599822462" observedRunningTime="2026-06-03 15:03:46.153938115 +0000 UTC m=+53.506908153" watchObservedRunningTime="2026-06-03 15:03:46.243528478 +0000 UTC m=+53.596498504" Jun 03 15:03:46.244239 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.244194 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c59dc554-qjbfg" podStartSLOduration=34.51604582 podStartE2EDuration="48.244181637s" podCreationTimestamp="2026-06-03 15:02:58 +0000 UTC" firstStartedPulling="2026-06-03 15:03:30.661268893 +0000 UTC m=+38.014238912" lastFinishedPulling="2026-06-03 15:03:44.389404725 +0000 UTC m=+51.742374729" observedRunningTime="2026-06-03 15:03:46.240590962 +0000 UTC m=+53.593561022" watchObservedRunningTime="2026-06-03 15:03:46.244181637 +0000 UTC m=+53.597151664" Jun 03 15:03:46.245906 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.245885 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-7dbrz"] Jun 03 15:03:46.269642 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.269617 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-7dbrz" Jun 03 15:03:46.275856 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.275673 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 15:03:46.277669 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.277457 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-l7244\"" Jun 03 15:03:46.280284 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.279518 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 15:03:46.339734 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.339679 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-7dbrz"] Jun 03 15:03:46.381007 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.380945 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-292tn\" (UniqueName: \"kubernetes.io/projected/efd18cdc-0c9b-40d3-9e6c-3e249d7f63b0-kube-api-access-292tn\") pod \"migrator-96c6f749-7dbrz\" (UID: \"efd18cdc-0c9b-40d3-9e6c-3e249d7f63b0\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-7dbrz" Jun 03 15:03:46.483580 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.483390 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-292tn\" (UniqueName: \"kubernetes.io/projected/efd18cdc-0c9b-40d3-9e6c-3e249d7f63b0-kube-api-access-292tn\") pod \"migrator-96c6f749-7dbrz\" (UID: \"efd18cdc-0c9b-40d3-9e6c-3e249d7f63b0\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-7dbrz" Jun 03 15:03:46.517995 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.517901 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-292tn\" (UniqueName: \"kubernetes.io/projected/efd18cdc-0c9b-40d3-9e6c-3e249d7f63b0-kube-api-access-292tn\") pod \"migrator-96c6f749-7dbrz\" (UID: \"efd18cdc-0c9b-40d3-9e6c-3e249d7f63b0\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-7dbrz" Jun 03 15:03:46.581251 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.581209 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-7dbrz" Jun 03 15:03:46.594668 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.594640 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hskk5_05144d0b-dd83-4d3c-9b43-4480b3fc8a35/console-operator/1.log" Jun 03 15:03:46.595185 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.595167 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hskk5_05144d0b-dd83-4d3c-9b43-4480b3fc8a35/console-operator/0.log" Jun 03 15:03:46.595252 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.595207 2577 generic.go:358] "Generic (PLEG): container finished" podID="05144d0b-dd83-4d3c-9b43-4480b3fc8a35" containerID="b990a8b38ae8ea8023514b6349b573f0ed0c5a73ab9a3c93701a482547baf30f" exitCode=255 Jun 03 15:03:46.595394 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.595352 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" event={"ID":"05144d0b-dd83-4d3c-9b43-4480b3fc8a35","Type":"ContainerDied","Data":"b990a8b38ae8ea8023514b6349b573f0ed0c5a73ab9a3c93701a482547baf30f"} Jun 03 15:03:46.595450 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.595412 2577 scope.go:117] "RemoveContainer" containerID="c1699572d1544018d99da19e50bad80890db15f24d3fd6ac41a2b0705353fbe3" Jun 03 15:03:46.596393 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:46.595970 2577 scope.go:117] "RemoveContainer" containerID="b990a8b38ae8ea8023514b6349b573f0ed0c5a73ab9a3c93701a482547baf30f" Jun 03 15:03:46.596393 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:46.596177 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-hskk5_openshift-console-operator(05144d0b-dd83-4d3c-9b43-4480b3fc8a35)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" podUID="05144d0b-dd83-4d3c-9b43-4480b3fc8a35" Jun 03 15:03:47.246954 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:47.246927 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-7dbrz"] Jun 03 15:03:47.253762 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:03:47.253735 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefd18cdc_0c9b_40d3_9e6c_3e249d7f63b0.slice/crio-b5dcd9651074bd21fdce65f11c6891a353d1636abca1627efb48e208afb42dbc WatchSource:0}: Error finding container b5dcd9651074bd21fdce65f11c6891a353d1636abca1627efb48e208afb42dbc: Status 404 returned error can't find the container with id b5dcd9651074bd21fdce65f11c6891a353d1636abca1627efb48e208afb42dbc Jun 03 15:03:47.600172 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:47.600152 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hskk5_05144d0b-dd83-4d3c-9b43-4480b3fc8a35/console-operator/1.log" Jun 03 15:03:47.600538 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:47.600520 2577 scope.go:117] "RemoveContainer" containerID="b990a8b38ae8ea8023514b6349b573f0ed0c5a73ab9a3c93701a482547baf30f" Jun 03 15:03:47.600776 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:47.600739 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-hskk5_openshift-console-operator(05144d0b-dd83-4d3c-9b43-4480b3fc8a35)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" podUID="05144d0b-dd83-4d3c-9b43-4480b3fc8a35" Jun 03 15:03:47.601346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:47.601318 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-7dbrz" event={"ID":"efd18cdc-0c9b-40d3-9e6c-3e249d7f63b0","Type":"ContainerStarted","Data":"b5dcd9651074bd21fdce65f11c6891a353d1636abca1627efb48e208afb42dbc"} Jun 03 15:03:48.383405 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:48.383357 2577 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" Jun 03 15:03:48.383582 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:48.383438 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" Jun 03 15:03:48.577493 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:48.577465 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4b7cx_00ed60d1-2492-44e1-864a-5028e232bb54/dns-node-resolver/0.log" Jun 03 15:03:48.606194 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:48.606153 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" event={"ID":"acc4bf03-9c54-471c-a6eb-2dec415170d6","Type":"ContainerStarted","Data":"0b77f544d0f0b3500fbdf207d9729c29ad5bc385e4fbbd531a32dc96fe54ac19"} Jun 03 15:03:48.606194 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:48.606197 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" event={"ID":"acc4bf03-9c54-471c-a6eb-2dec415170d6","Type":"ContainerStarted","Data":"e79cb1c7cb2e71a647aeccf3c721fc28d90744997cd23564d70a6db545d5108d"} Jun 03 15:03:48.606711 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:48.606461 2577 scope.go:117] "RemoveContainer" containerID="b990a8b38ae8ea8023514b6349b573f0ed0c5a73ab9a3c93701a482547baf30f" Jun 03 15:03:48.606711 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:48.606656 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-hskk5_openshift-console-operator(05144d0b-dd83-4d3c-9b43-4480b3fc8a35)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" podUID="05144d0b-dd83-4d3c-9b43-4480b3fc8a35" Jun 03 15:03:49.047949 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.047898 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" podStartSLOduration=34.178615347 podStartE2EDuration="51.047880506s" podCreationTimestamp="2026-06-03 15:02:58 +0000 UTC" firstStartedPulling="2026-06-03 15:03:30.661416243 +0000 UTC m=+38.014386255" lastFinishedPulling="2026-06-03 15:03:47.530681406 +0000 UTC m=+54.883651414" observedRunningTime="2026-06-03 15:03:48.653087333 +0000 UTC m=+56.006057395" watchObservedRunningTime="2026-06-03 15:03:49.047880506 +0000 UTC m=+56.400850536" Jun 03 15:03:49.048656 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.048619 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-hb569"] Jun 03 15:03:49.070117 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.070086 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-hb569" Jun 03 15:03:49.078593 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.078558 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 15:03:49.078593 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.078586 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 15:03:49.078793 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.078600 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-j287c\"" Jun 03 15:03:49.088115 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.088087 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 15:03:49.088231 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.088100 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 15:03:49.092557 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.092537 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-hb569"] Jun 03 15:03:49.212171 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.212138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0f1a08cb-e13b-43eb-bb31-69ab10d5376f-signing-key\") pod \"service-ca-685df94d57-hb569\" (UID: \"0f1a08cb-e13b-43eb-bb31-69ab10d5376f\") " pod="openshift-service-ca/service-ca-685df94d57-hb569" Jun 03 15:03:49.212342 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.212215 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6dsr\" (UniqueName: \"kubernetes.io/projected/0f1a08cb-e13b-43eb-bb31-69ab10d5376f-kube-api-access-s6dsr\") pod \"service-ca-685df94d57-hb569\" (UID: \"0f1a08cb-e13b-43eb-bb31-69ab10d5376f\") " pod="openshift-service-ca/service-ca-685df94d57-hb569" Jun 03 15:03:49.212415 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.212383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0f1a08cb-e13b-43eb-bb31-69ab10d5376f-signing-cabundle\") pod \"service-ca-685df94d57-hb569\" (UID: \"0f1a08cb-e13b-43eb-bb31-69ab10d5376f\") " pod="openshift-service-ca/service-ca-685df94d57-hb569" Jun 03 15:03:49.314043 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.313959 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0f1a08cb-e13b-43eb-bb31-69ab10d5376f-signing-key\") pod \"service-ca-685df94d57-hb569\" (UID: \"0f1a08cb-e13b-43eb-bb31-69ab10d5376f\") " pod="openshift-service-ca/service-ca-685df94d57-hb569" Jun 03 15:03:49.314213 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.314052 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6dsr\" (UniqueName: \"kubernetes.io/projected/0f1a08cb-e13b-43eb-bb31-69ab10d5376f-kube-api-access-s6dsr\") pod \"service-ca-685df94d57-hb569\" (UID: \"0f1a08cb-e13b-43eb-bb31-69ab10d5376f\") " pod="openshift-service-ca/service-ca-685df94d57-hb569" Jun 03 15:03:49.314278 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.314210 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0f1a08cb-e13b-43eb-bb31-69ab10d5376f-signing-cabundle\") pod \"service-ca-685df94d57-hb569\" (UID: \"0f1a08cb-e13b-43eb-bb31-69ab10d5376f\") " pod="openshift-service-ca/service-ca-685df94d57-hb569" Jun 03 15:03:49.314968 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.314941 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0f1a08cb-e13b-43eb-bb31-69ab10d5376f-signing-cabundle\") pod \"service-ca-685df94d57-hb569\" (UID: \"0f1a08cb-e13b-43eb-bb31-69ab10d5376f\") " pod="openshift-service-ca/service-ca-685df94d57-hb569" Jun 03 15:03:49.316587 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.316566 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0f1a08cb-e13b-43eb-bb31-69ab10d5376f-signing-key\") pod \"service-ca-685df94d57-hb569\" (UID: \"0f1a08cb-e13b-43eb-bb31-69ab10d5376f\") " pod="openshift-service-ca/service-ca-685df94d57-hb569" Jun 03 15:03:49.338186 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.338161 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6dsr\" (UniqueName: \"kubernetes.io/projected/0f1a08cb-e13b-43eb-bb31-69ab10d5376f-kube-api-access-s6dsr\") pod \"service-ca-685df94d57-hb569\" (UID: \"0f1a08cb-e13b-43eb-bb31-69ab10d5376f\") " pod="openshift-service-ca/service-ca-685df94d57-hb569" Jun 03 15:03:49.380902 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.380871 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-hb569" Jun 03 15:03:49.997769 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:49.997576 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mfll7_c8756071-49e9-431b-86a8-d179d071de13/node-ca/0.log" Jun 03 15:03:50.110809 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:50.110774 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-hb569"] Jun 03 15:03:50.114516 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:03:50.114486 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f1a08cb_e13b_43eb_bb31_69ab10d5376f.slice/crio-ccfefadb5b8b087a034954f54d4c81e80267bbcdfb6a1732f4d3a519116cc3e8 WatchSource:0}: Error finding container ccfefadb5b8b087a034954f54d4c81e80267bbcdfb6a1732f4d3a519116cc3e8: Status 404 returned error can't find the container with id ccfefadb5b8b087a034954f54d4c81e80267bbcdfb6a1732f4d3a519116cc3e8 Jun 03 15:03:50.613432 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:50.613393 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d6kcq" event={"ID":"4a0def35-868d-4101-9dc2-c4f9f817ac49","Type":"ContainerStarted","Data":"7b83b31995390ce22be69edfb2c2e3a0716af931c6946fa0871a99aa39fd5f67"} Jun 03 15:03:50.614956 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:50.614925 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-7dbrz" event={"ID":"efd18cdc-0c9b-40d3-9e6c-3e249d7f63b0","Type":"ContainerStarted","Data":"ad6f230725c5d6ce3f70b4cce7e3f35952e47b0c8997ff799ef2b4ff99574aca"} Jun 03 15:03:50.615085 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:50.614959 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-7dbrz" event={"ID":"efd18cdc-0c9b-40d3-9e6c-3e249d7f63b0","Type":"ContainerStarted","Data":"41e5ffdcd79cb86d5df233e5f851329293552b43dae50e2b12b10f10115ec967"} Jun 03 15:03:50.616212 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:50.616190 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-hb569" event={"ID":"0f1a08cb-e13b-43eb-bb31-69ab10d5376f","Type":"ContainerStarted","Data":"3955301e52e4a2d9483b385846f7e0406163698949edaa12dd81b47f9df0a915"} Jun 03 15:03:50.616305 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:50.616215 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-hb569" event={"ID":"0f1a08cb-e13b-43eb-bb31-69ab10d5376f","Type":"ContainerStarted","Data":"ccfefadb5b8b087a034954f54d4c81e80267bbcdfb6a1732f4d3a519116cc3e8"} Jun 03 15:03:50.649638 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:50.649597 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d6kcq" podStartSLOduration=8.278255468 podStartE2EDuration="13.649585055s" podCreationTimestamp="2026-06-03 15:03:37 +0000 UTC" firstStartedPulling="2026-06-03 15:03:44.541798342 +0000 UTC m=+51.894768355" lastFinishedPulling="2026-06-03 15:03:49.913127933 +0000 UTC m=+57.266097942" observedRunningTime="2026-06-03 15:03:50.649391179 +0000 UTC m=+58.002361206" watchObservedRunningTime="2026-06-03 15:03:50.649585055 +0000 UTC m=+58.002555059" Jun 03 15:03:50.691309 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:50.691262 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-7dbrz" podStartSLOduration=2.04075265 podStartE2EDuration="4.691248337s" podCreationTimestamp="2026-06-03 15:03:46 +0000 UTC" firstStartedPulling="2026-06-03 15:03:47.255473049 +0000 UTC m=+54.608443053" lastFinishedPulling="2026-06-03 15:03:49.905968734 +0000 UTC m=+57.258938740" observedRunningTime="2026-06-03 15:03:50.69072029 +0000 UTC m=+58.043690327" watchObservedRunningTime="2026-06-03 15:03:50.691248337 +0000 UTC m=+58.044218364" Jun 03 15:03:50.730776 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:50.730723 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-hb569" podStartSLOduration=1.7307066469999999 podStartE2EDuration="1.730706647s" podCreationTimestamp="2026-06-03 15:03:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:03:50.729410488 +0000 UTC m=+58.082380520" watchObservedRunningTime="2026-06-03 15:03:50.730706647 +0000 UTC m=+58.083676674" Jun 03 15:03:50.779434 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:50.779404 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-7dbrz_efd18cdc-0c9b-40d3-9e6c-3e249d7f63b0/graceful-termination/0.log" Jun 03 15:03:50.974675 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:50.974591 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-vzpss_6c1d6767-775a-4feb-ab75-d42366001da8/kube-storage-version-migrator-operator/0.log" Jun 03 15:03:53.396353 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:53.396328 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfwpp" Jun 03 15:03:58.909104 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:58.909064 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs\") pod \"network-metrics-daemon-klxj7\" (UID: \"80b3ece5-3176-4984-821a-d8817e635c90\") " pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:03:58.913149 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:58.913128 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 15:03:58.920222 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:58.920205 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 15:03:58.920292 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:03:58.920264 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs podName:80b3ece5-3176-4984-821a-d8817e635c90 nodeName:}" failed. No retries permitted until 2026-06-03 15:05:02.920243879 +0000 UTC m=+130.273213884 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs") pod "network-metrics-daemon-klxj7" (UID: "80b3ece5-3176-4984-821a-d8817e635c90") : secret "metrics-daemon-secret" not found Jun 03 15:03:59.010726 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:59.010688 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkh42\" (UniqueName: \"kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42\") pod \"network-check-target-6wc5f\" (UID: \"0d5c6c4b-7b87-42f1-b959-938ef9c698fc\") " pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:59.013375 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:59.013329 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkh42\" (UniqueName: \"kubernetes.io/projected/0d5c6c4b-7b87-42f1-b959-938ef9c698fc-kube-api-access-hkh42\") pod \"network-check-target-6wc5f\" (UID: \"0d5c6c4b-7b87-42f1-b959-938ef9c698fc\") " pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:59.272407 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:59.272302 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zkmcm\"" Jun 03 15:03:59.279992 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:59.279956 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:59.467770 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:59.467736 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6wc5f"] Jun 03 15:03:59.468856 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:03:59.468814 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d5c6c4b_7b87_42f1_b959_938ef9c698fc.slice/crio-0f3266aad4416e1158e4f344b772a896ac6734f8cf50b7ebebed1777e5f7e02b WatchSource:0}: Error finding container 0f3266aad4416e1158e4f344b772a896ac6734f8cf50b7ebebed1777e5f7e02b: Status 404 returned error can't find the container with id 0f3266aad4416e1158e4f344b772a896ac6734f8cf50b7ebebed1777e5f7e02b Jun 03 15:03:59.645434 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:59.645395 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6wc5f" event={"ID":"0d5c6c4b-7b87-42f1-b959-938ef9c698fc","Type":"ContainerStarted","Data":"05f089f78216b253f06220f0e7c1fb6749681054f789693afefd086e5631e49d"} Jun 03 15:03:59.645434 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:59.645438 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6wc5f" event={"ID":"0d5c6c4b-7b87-42f1-b959-938ef9c698fc","Type":"ContainerStarted","Data":"0f3266aad4416e1158e4f344b772a896ac6734f8cf50b7ebebed1777e5f7e02b"} Jun 03 15:03:59.645636 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:59.645467 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:03:59.919874 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:59.919789 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:03:59.922234 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:03:59.922214 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls\") pod \"image-registry-774f88d448-wpp89\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:04:00.021092 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.021054 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:04:00.021243 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.021111 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:04:00.021243 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.021168 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-fdjbh\" (UID: \"3a300de4-981a-4bee-8f25-c25a10a85d29\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh" Jun 03 15:04:00.021243 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.021200 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls\") pod \"dns-default-gbhfn\" (UID: \"466be55f-b28b-4b72-979e-b679d95de62c\") " pod="openshift-dns/dns-default-gbhfn" Jun 03 15:04:00.021426 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.021240 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-88whh\" (UID: \"399fce46-fa37-43a7-b31e-0e5848d3735e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" Jun 03 15:04:00.021426 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.021308 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:04:00.021426 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.021349 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-ndlpw\" (UID: \"e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw" Jun 03 15:04:00.021870 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.021841 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6b8dc06-9393-43f8-a071-e7ef74839d86-service-ca-bundle\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:04:00.023742 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.023675 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6b8dc06-9393-43f8-a071-e7ef74839d86-metrics-certs\") pod \"router-default-64cd489db9-fdf9z\" (UID: \"c6b8dc06-9393-43f8-a071-e7ef74839d86\") " pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:04:00.024058 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.024030 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/466be55f-b28b-4b72-979e-b679d95de62c-metrics-tls\") pod \"dns-default-gbhfn\" (UID: \"466be55f-b28b-4b72-979e-b679d95de62c\") " pod="openshift-dns/dns-default-gbhfn" Jun 03 15:04:00.024170 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.024115 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/399fce46-fa37-43a7-b31e-0e5848d3735e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-88whh\" (UID: \"399fce46-fa37-43a7-b31e-0e5848d3735e\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" Jun 03 15:04:00.024230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.024175 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls\") pod \"image-registry-bb8d97579-px8fb\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:04:00.024285 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.024264 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-ndlpw\" (UID: \"e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw" Jun 03 15:04:00.024333 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.024265 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a300de4-981a-4bee-8f25-c25a10a85d29-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-fdjbh\" (UID: \"3a300de4-981a-4bee-8f25-c25a10a85d29\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh" Jun 03 15:04:00.117470 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.117437 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-24k7v\"" Jun 03 15:04:00.122607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.122584 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert\") pod \"ingress-canary-wp7ml\" (UID: \"747b2535-7bfc-402d-ab7c-b645e8c06569\") " pod="openshift-ingress-canary/ingress-canary-wp7ml" Jun 03 15:04:00.124030 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.124009 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:04:00.124875 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.124859 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/747b2535-7bfc-402d-ab7c-b645e8c06569-cert\") pod \"ingress-canary-wp7ml\" (UID: \"747b2535-7bfc-402d-ab7c-b645e8c06569\") " pod="openshift-ingress-canary/ingress-canary-wp7ml" Jun 03 15:04:00.136229 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.136208 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4rbkc\"" Jun 03 15:04:00.143088 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.143065 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:04:00.156471 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.156450 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-f2wvd\"" Jun 03 15:04:00.161084 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.161060 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw" Jun 03 15:04:00.164223 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.164201 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hwv8v\"" Jun 03 15:04:00.170511 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.170458 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh" Jun 03 15:04:00.170754 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.170735 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m5pnr\"" Jun 03 15:04:00.177762 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.177738 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gbhfn" Jun 03 15:04:00.181782 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.178461 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wl52x\"" Jun 03 15:04:00.188483 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.188083 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" Jun 03 15:04:00.198163 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.197781 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:04:00.239835 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.239801 2577 scope.go:117] "RemoveContainer" containerID="b990a8b38ae8ea8023514b6349b573f0ed0c5a73ab9a3c93701a482547baf30f" Jun 03 15:04:00.253110 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.252877 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p69ds\"" Jun 03 15:04:00.265027 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.260503 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wp7ml" Jun 03 15:04:00.411479 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.403329 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6wc5f" podStartSLOduration=67.403307111 podStartE2EDuration="1m7.403307111s" podCreationTimestamp="2026-06-03 15:02:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:03:59.680649505 +0000 UTC m=+67.033619530" watchObservedRunningTime="2026-06-03 15:04:00.403307111 +0000 UTC m=+67.756277139" Jun 03 15:04:00.411479 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.411428 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-774f88d448-wpp89"] Jun 03 15:04:00.432842 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.431024 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64cd489db9-fdf9z"] Jun 03 15:04:00.442924 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:04:00.442877 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b8dc06_9393_43f8_a071_e7ef74839d86.slice/crio-4bfe7e59ab8a2bb28c70bf7d41fd01837e8cf7b369f89ac62b2c10a628dcffb4 WatchSource:0}: Error finding container 4bfe7e59ab8a2bb28c70bf7d41fd01837e8cf7b369f89ac62b2c10a628dcffb4: Status 404 returned error can't find the container with id 4bfe7e59ab8a2bb28c70bf7d41fd01837e8cf7b369f89ac62b2c10a628dcffb4 Jun 03 15:04:00.526936 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.526905 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh"] Jun 03 15:04:00.533581 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.533560 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bb8d97579-px8fb"] Jun 03 15:04:00.539950 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.539929 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw"] Jun 03 15:04:00.562791 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:04:00.560245 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5cc1a7b_de22_4984_94d2_a6c717d2acf3.slice/crio-0b83d9454ab3ca870dd46855ad24b2ee6f72f792b56976fe6b4a62eedc21875b WatchSource:0}: Error finding container 0b83d9454ab3ca870dd46855ad24b2ee6f72f792b56976fe6b4a62eedc21875b: Status 404 returned error can't find the container with id 0b83d9454ab3ca870dd46855ad24b2ee6f72f792b56976fe6b4a62eedc21875b Jun 03 15:04:00.563383 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:04:00.563232 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a300de4_981a_4bee_8f25_c25a10a85d29.slice/crio-144f4e254053c5163638c4a669aa7353e935e9862b1a6f8df84f9fda252874f2 WatchSource:0}: Error finding container 144f4e254053c5163638c4a669aa7353e935e9862b1a6f8df84f9fda252874f2: Status 404 returned error can't find the container with id 144f4e254053c5163638c4a669aa7353e935e9862b1a6f8df84f9fda252874f2 Jun 03 15:04:00.634004 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.633938 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wp7ml"] Jun 03 15:04:00.635834 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.635810 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh"] Jun 03 15:04:00.637314 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:04:00.637282 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod399fce46_fa37_43a7_b31e_0e5848d3735e.slice/crio-7887128cbb8351e6f26254183064d17ce80c93e2fd6b869577553ebedd6ffc02 WatchSource:0}: Error finding container 7887128cbb8351e6f26254183064d17ce80c93e2fd6b869577553ebedd6ffc02: Status 404 returned error can't find the container with id 7887128cbb8351e6f26254183064d17ce80c93e2fd6b869577553ebedd6ffc02 Jun 03 15:04:00.637719 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:04:00.637692 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747b2535_7bfc_402d_ab7c_b645e8c06569.slice/crio-8ee22ace21b2e82b73bbc2d11a77b47dc76e42b625892bd23497e60df9724611 WatchSource:0}: Error finding container 8ee22ace21b2e82b73bbc2d11a77b47dc76e42b625892bd23497e60df9724611: Status 404 returned error can't find the container with id 8ee22ace21b2e82b73bbc2d11a77b47dc76e42b625892bd23497e60df9724611 Jun 03 15:04:00.643292 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.643229 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gbhfn"] Jun 03 15:04:00.650870 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.650557 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-774f88d448-wpp89" event={"ID":"866c3310-011a-4ab6-b677-93e8eeabd1d6","Type":"ContainerStarted","Data":"4c897e355ce625f6a1dc90f5c2b961bf2fa3c622816f16d45850d3d2316900b1"} Jun 03 15:04:00.650870 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.650598 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-774f88d448-wpp89" event={"ID":"866c3310-011a-4ab6-b677-93e8eeabd1d6","Type":"ContainerStarted","Data":"aeb578768e228e8c29497201d576dbf7ab27860d4f04e557c491ef9d8e40c082"} Jun 03 15:04:00.650870 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.650635 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:04:00.653468 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.653358 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hskk5_05144d0b-dd83-4d3c-9b43-4480b3fc8a35/console-operator/1.log" Jun 03 15:04:00.653468 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.653460 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" event={"ID":"05144d0b-dd83-4d3c-9b43-4480b3fc8a35","Type":"ContainerStarted","Data":"5e96e5449e730e1409e053d1ea981803c3b89b04a762a73669fce7244e823512"} Jun 03 15:04:00.653799 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.653757 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" Jun 03 15:04:00.655625 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.655597 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bb8d97579-px8fb" event={"ID":"f5cc1a7b-de22-4984-94d2-a6c717d2acf3","Type":"ContainerStarted","Data":"0b83d9454ab3ca870dd46855ad24b2ee6f72f792b56976fe6b4a62eedc21875b"} Jun 03 15:04:00.656939 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.656914 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh" event={"ID":"3a300de4-981a-4bee-8f25-c25a10a85d29","Type":"ContainerStarted","Data":"144f4e254053c5163638c4a669aa7353e935e9862b1a6f8df84f9fda252874f2"} Jun 03 15:04:00.659643 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:04:00.659623 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod466be55f_b28b_4b72_979e_b679d95de62c.slice/crio-65d4864889e2cbc7c28bcdb74919da741071898660bae00373600bc303ca9e10 WatchSource:0}: Error finding container 65d4864889e2cbc7c28bcdb74919da741071898660bae00373600bc303ca9e10: Status 404 returned error can't find the container with id 65d4864889e2cbc7c28bcdb74919da741071898660bae00373600bc303ca9e10 Jun 03 15:04:00.659953 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.659933 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wp7ml" event={"ID":"747b2535-7bfc-402d-ab7c-b645e8c06569","Type":"ContainerStarted","Data":"8ee22ace21b2e82b73bbc2d11a77b47dc76e42b625892bd23497e60df9724611"} Jun 03 15:04:00.661890 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.661579 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64cd489db9-fdf9z" event={"ID":"c6b8dc06-9393-43f8-a071-e7ef74839d86","Type":"ContainerStarted","Data":"66f9c807d55980c595ed5ab09b5ca6281c79e13b565b017c9b32e34ed6dbf085"} Jun 03 15:04:00.661890 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.661603 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64cd489db9-fdf9z" event={"ID":"c6b8dc06-9393-43f8-a071-e7ef74839d86","Type":"ContainerStarted","Data":"4bfe7e59ab8a2bb28c70bf7d41fd01837e8cf7b369f89ac62b2c10a628dcffb4"} Jun 03 15:04:00.663241 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.663180 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" event={"ID":"399fce46-fa37-43a7-b31e-0e5848d3735e","Type":"ContainerStarted","Data":"7887128cbb8351e6f26254183064d17ce80c93e2fd6b869577553ebedd6ffc02"} Jun 03 15:04:00.664353 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.664325 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw" event={"ID":"e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53","Type":"ContainerStarted","Data":"13d0f6e8bf682f5c608e223c2ea54a3c91195f3687b178e9c2594c3529cbc4c3"} Jun 03 15:04:00.769981 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.769882 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-774f88d448-wpp89" podStartSLOduration=67.769862249 podStartE2EDuration="1m7.769862249s" podCreationTimestamp="2026-06-03 15:02:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:04:00.730597163 +0000 UTC m=+68.083567192" watchObservedRunningTime="2026-06-03 15:04:00.769862249 +0000 UTC m=+68.122832277" Jun 03 15:04:00.770462 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.770423 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" podStartSLOduration=41.032554505 podStartE2EDuration="54.770415561s" podCreationTimestamp="2026-06-03 15:03:06 +0000 UTC" firstStartedPulling="2026-06-03 15:03:30.632923764 +0000 UTC m=+37.985893771" lastFinishedPulling="2026-06-03 15:03:44.370784808 +0000 UTC m=+51.723754827" observedRunningTime="2026-06-03 15:04:00.768441744 +0000 UTC m=+68.121411771" watchObservedRunningTime="2026-06-03 15:04:00.770415561 +0000 UTC m=+68.123385586" Jun 03 15:04:00.837664 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:00.837615 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-64cd489db9-fdf9z" podStartSLOduration=54.837600823 podStartE2EDuration="54.837600823s" podCreationTimestamp="2026-06-03 15:03:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:04:00.837079516 +0000 UTC m=+68.190049543" watchObservedRunningTime="2026-06-03 15:04:00.837600823 +0000 UTC m=+68.190570849" Jun 03 15:04:01.143683 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:01.143649 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:04:01.146405 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:01.146353 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:04:01.655802 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:01.655455 2577 patch_prober.go:28] interesting pod/console-operator-86d7c6cc77-hskk5 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.14:8443/readyz\": context deadline exceeded" start-of-body= Jun 03 15:04:01.655802 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:01.655527 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" podUID="05144d0b-dd83-4d3c-9b43-4480b3fc8a35" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.14:8443/readyz\": context deadline exceeded" Jun 03 15:04:01.670921 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:01.670864 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gbhfn" event={"ID":"466be55f-b28b-4b72-979e-b679d95de62c","Type":"ContainerStarted","Data":"65d4864889e2cbc7c28bcdb74919da741071898660bae00373600bc303ca9e10"} Jun 03 15:04:01.681790 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:01.677258 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bb8d97579-px8fb" event={"ID":"f5cc1a7b-de22-4984-94d2-a6c717d2acf3","Type":"ContainerStarted","Data":"b39395ee8a3d089b05489db4951ccc1c9f540957459d5ace9a6c846309550b65"} Jun 03 15:04:01.681790 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:01.678457 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:04:01.681790 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:01.678482 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:04:01.681790 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:01.679785 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-64cd489db9-fdf9z" Jun 03 15:04:01.711010 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:01.710980 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-hskk5" Jun 03 15:04:01.754232 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:01.753449 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-bb8d97579-px8fb" podStartSLOduration=55.753432532 podStartE2EDuration="55.753432532s" podCreationTimestamp="2026-06-03 15:03:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:04:01.75149161 +0000 UTC m=+69.104461637" watchObservedRunningTime="2026-06-03 15:04:01.753432532 +0000 UTC m=+69.106402559" Jun 03 15:04:04.687615 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:04.687535 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gbhfn" event={"ID":"466be55f-b28b-4b72-979e-b679d95de62c","Type":"ContainerStarted","Data":"7187219b9bbb085850a0dfde37450ca7b75752cddeb6877d0fb90fcd70b1321a"} Jun 03 15:04:04.687615 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:04.687589 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gbhfn" event={"ID":"466be55f-b28b-4b72-979e-b679d95de62c","Type":"ContainerStarted","Data":"05a581bfcf98ab1558e247db55a0ba8a33c693781a888310a28df9f1d2bb7a7f"} Jun 03 15:04:04.688248 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:04.688203 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gbhfn" Jun 03 15:04:04.689157 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:04.689135 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wp7ml" event={"ID":"747b2535-7bfc-402d-ab7c-b645e8c06569","Type":"ContainerStarted","Data":"2995c8491ed0c812610f5e09a4a1d73fbff2233a06570ada9985ad3b2f452e82"} Jun 03 15:04:04.690812 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:04.690787 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" event={"ID":"399fce46-fa37-43a7-b31e-0e5848d3735e","Type":"ContainerStarted","Data":"056dda2ea20c275c2ea22101e80cce67912ddef0ab57d9d62fbd63e3176385a6"} Jun 03 15:04:04.694017 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:04.693968 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw" event={"ID":"e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53","Type":"ContainerStarted","Data":"86a7048ab83d5ebd02571b71bff2fd4315468b82175c7f800a5de2b8b31dcc3e"} Jun 03 15:04:04.694017 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:04.693991 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw" event={"ID":"e28967e6-3ee9-4a6b-8d20-41ac6b0e1e53","Type":"ContainerStarted","Data":"3c4f5f3da98ea53a1d06ca2060fad08d749facb3232de8a1036a9e5980263aad"} Jun 03 15:04:04.695860 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:04.695836 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh" event={"ID":"3a300de4-981a-4bee-8f25-c25a10a85d29","Type":"ContainerStarted","Data":"3051b1826b273c047a53b453e98eac3462a0c62a27d9c38dfcf38d876a7f7640"} Jun 03 15:04:04.749945 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:04.749890 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-88whh" podStartSLOduration=54.970371016 podStartE2EDuration="58.749872356s" podCreationTimestamp="2026-06-03 15:03:06 +0000 UTC" firstStartedPulling="2026-06-03 15:04:00.639246526 +0000 UTC m=+67.992216534" lastFinishedPulling="2026-06-03 15:04:04.418747868 +0000 UTC m=+71.771717874" observedRunningTime="2026-06-03 15:04:04.749415603 +0000 UTC m=+72.102385629" watchObservedRunningTime="2026-06-03 15:04:04.749872356 +0000 UTC m=+72.102842387" Jun 03 15:04:04.750935 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:04.750895 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-gbhfn" podStartSLOduration=33.988974728 podStartE2EDuration="37.750880072s" podCreationTimestamp="2026-06-03 15:03:27 +0000 UTC" firstStartedPulling="2026-06-03 15:04:00.661311337 +0000 UTC m=+68.014281349" lastFinishedPulling="2026-06-03 15:04:04.423216688 +0000 UTC m=+71.776186693" observedRunningTime="2026-06-03 15:04:04.719467831 +0000 UTC m=+72.072437856" watchObservedRunningTime="2026-06-03 15:04:04.750880072 +0000 UTC m=+72.103850098" Jun 03 15:04:04.791780 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:04.791729 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-ndlpw" podStartSLOduration=54.998633764 podStartE2EDuration="58.791713819s" podCreationTimestamp="2026-06-03 15:03:06 +0000 UTC" firstStartedPulling="2026-06-03 15:04:00.628873021 +0000 UTC m=+67.981843028" lastFinishedPulling="2026-06-03 15:04:04.421953068 +0000 UTC m=+71.774923083" observedRunningTime="2026-06-03 15:04:04.790662443 +0000 UTC m=+72.143632474" watchObservedRunningTime="2026-06-03 15:04:04.791713819 +0000 UTC m=+72.144683845" Jun 03 15:04:04.841842 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:04.841792 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-fdjbh" podStartSLOduration=54.989672436 podStartE2EDuration="58.841775813s" podCreationTimestamp="2026-06-03 15:03:06 +0000 UTC" firstStartedPulling="2026-06-03 15:04:00.565778218 +0000 UTC m=+67.918748224" lastFinishedPulling="2026-06-03 15:04:04.417881597 +0000 UTC m=+71.770851601" observedRunningTime="2026-06-03 15:04:04.840330586 +0000 UTC m=+72.193300611" watchObservedRunningTime="2026-06-03 15:04:04.841775813 +0000 UTC m=+72.194745841" Jun 03 15:04:04.889700 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:04.889651 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wp7ml" podStartSLOduration=33.115001841 podStartE2EDuration="36.889637209s" podCreationTimestamp="2026-06-03 15:03:28 +0000 UTC" firstStartedPulling="2026-06-03 15:04:00.645346401 +0000 UTC m=+67.998316409" lastFinishedPulling="2026-06-03 15:04:04.419981773 +0000 UTC m=+71.772951777" observedRunningTime="2026-06-03 15:04:04.886713547 +0000 UTC m=+72.239683573" watchObservedRunningTime="2026-06-03 15:04:04.889637209 +0000 UTC m=+72.242607236" Jun 03 15:04:13.541551 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.541517 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5448fd56c5-qcvlr"] Jun 03 15:04:13.635407 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.635360 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-z6jjd"] Jun 03 15:04:13.635585 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.635557 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.647851 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.647826 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 15:04:13.647981 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.647904 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 15:04:13.649298 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.649277 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-7d9x6"] Jun 03 15:04:13.649436 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.649419 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-z6jjd" Jun 03 15:04:13.650915 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.650892 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 15:04:13.651041 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.651016 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 15:04:13.651041 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.651021 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 15:04:13.651212 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.651095 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z5s6r\"" Jun 03 15:04:13.651293 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.651271 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 15:04:13.651353 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.651332 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 15:04:13.671494 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.671471 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-z6jjd"] Jun 03 15:04:13.671494 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.671495 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5448fd56c5-qcvlr"] Jun 03 15:04:13.671623 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.671506 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bb8d97579-px8fb"] Jun 03 15:04:13.671623 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.671599 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-7d9x6" Jun 03 15:04:13.676938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.676886 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 03 15:04:13.677151 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.677136 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qhp4w\"" Jun 03 15:04:13.721685 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.721657 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-t5tkv\"" Jun 03 15:04:13.723082 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.723057 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-7d9x6"] Jun 03 15:04:13.731489 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.731465 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wrzg5"] Jun 03 15:04:13.748568 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.748548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bd2d02c5-5aac-4af9-84af-6064147e26d6-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-z6jjd\" (UID: \"bd2d02c5-5aac-4af9-84af-6064147e26d6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-z6jjd" Jun 03 15:04:13.748660 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.748585 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/563794dc-3226-4b76-83a8-e5992deda67a-console-serving-cert\") pod \"console-5448fd56c5-qcvlr\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.748660 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.748602 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jf4h\" (UniqueName: \"kubernetes.io/projected/b1623a8b-9473-4fe6-996e-864cd730ddfa-kube-api-access-8jf4h\") pod \"downloads-c65b8dc4b-7d9x6\" (UID: \"b1623a8b-9473-4fe6-996e-864cd730ddfa\") " pod="openshift-console/downloads-c65b8dc4b-7d9x6" Jun 03 15:04:13.748660 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.748619 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/563794dc-3226-4b76-83a8-e5992deda67a-console-config\") pod \"console-5448fd56c5-qcvlr\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.748769 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.748702 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ppk4\" (UniqueName: \"kubernetes.io/projected/563794dc-3226-4b76-83a8-e5992deda67a-kube-api-access-7ppk4\") pod \"console-5448fd56c5-qcvlr\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.748769 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.748740 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/563794dc-3226-4b76-83a8-e5992deda67a-console-oauth-config\") pod \"console-5448fd56c5-qcvlr\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.748843 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.748774 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/563794dc-3226-4b76-83a8-e5992deda67a-service-ca\") pod \"console-5448fd56c5-qcvlr\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.748843 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.748791 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/563794dc-3226-4b76-83a8-e5992deda67a-oauth-serving-cert\") pod \"console-5448fd56c5-qcvlr\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.753545 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.753530 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wrzg5" Jun 03 15:04:13.791114 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.791089 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d8b8x\"" Jun 03 15:04:13.791382 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.791346 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 15:04:13.846702 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.846664 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 15:04:13.849519 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.849498 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/563794dc-3226-4b76-83a8-e5992deda67a-service-ca\") pod \"console-5448fd56c5-qcvlr\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.849654 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.849530 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/563794dc-3226-4b76-83a8-e5992deda67a-oauth-serving-cert\") pod \"console-5448fd56c5-qcvlr\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.849654 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.849595 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54259166-c5f7-4ebf-9f36-206473a31278-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wrzg5\" (UID: \"54259166-c5f7-4ebf-9f36-206473a31278\") " pod="openshift-insights/insights-runtime-extractor-wrzg5" Jun 03 15:04:13.849654 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.849631 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wrzg5"] Jun 03 15:04:13.849654 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.849637 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54259166-c5f7-4ebf-9f36-206473a31278-crio-socket\") pod \"insights-runtime-extractor-wrzg5\" (UID: \"54259166-c5f7-4ebf-9f36-206473a31278\") " pod="openshift-insights/insights-runtime-extractor-wrzg5" Jun 03 15:04:13.849853 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.849684 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bd2d02c5-5aac-4af9-84af-6064147e26d6-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-z6jjd\" (UID: \"bd2d02c5-5aac-4af9-84af-6064147e26d6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-z6jjd" Jun 03 15:04:13.849853 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.849726 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/563794dc-3226-4b76-83a8-e5992deda67a-console-serving-cert\") pod \"console-5448fd56c5-qcvlr\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.849853 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.849752 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jf4h\" (UniqueName: \"kubernetes.io/projected/b1623a8b-9473-4fe6-996e-864cd730ddfa-kube-api-access-8jf4h\") pod \"downloads-c65b8dc4b-7d9x6\" (UID: \"b1623a8b-9473-4fe6-996e-864cd730ddfa\") " pod="openshift-console/downloads-c65b8dc4b-7d9x6" Jun 03 15:04:13.849853 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.849778 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/563794dc-3226-4b76-83a8-e5992deda67a-console-config\") pod \"console-5448fd56c5-qcvlr\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.849853 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.849821 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5m6s\" (UniqueName: \"kubernetes.io/projected/54259166-c5f7-4ebf-9f36-206473a31278-kube-api-access-w5m6s\") pod \"insights-runtime-extractor-wrzg5\" (UID: \"54259166-c5f7-4ebf-9f36-206473a31278\") " pod="openshift-insights/insights-runtime-extractor-wrzg5" Jun 03 15:04:13.850102 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.850045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54259166-c5f7-4ebf-9f36-206473a31278-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wrzg5\" (UID: \"54259166-c5f7-4ebf-9f36-206473a31278\") " pod="openshift-insights/insights-runtime-extractor-wrzg5" Jun 03 15:04:13.850156 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.850107 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ppk4\" (UniqueName: \"kubernetes.io/projected/563794dc-3226-4b76-83a8-e5992deda67a-kube-api-access-7ppk4\") pod \"console-5448fd56c5-qcvlr\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.850208 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.850153 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/563794dc-3226-4b76-83a8-e5992deda67a-console-oauth-config\") pod \"console-5448fd56c5-qcvlr\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.850260 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.850203 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54259166-c5f7-4ebf-9f36-206473a31278-data-volume\") pod \"insights-runtime-extractor-wrzg5\" (UID: \"54259166-c5f7-4ebf-9f36-206473a31278\") " pod="openshift-insights/insights-runtime-extractor-wrzg5" Jun 03 15:04:13.850313 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.850298 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/563794dc-3226-4b76-83a8-e5992deda67a-oauth-serving-cert\") pod \"console-5448fd56c5-qcvlr\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.850542 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.850484 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/563794dc-3226-4b76-83a8-e5992deda67a-console-config\") pod \"console-5448fd56c5-qcvlr\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.850542 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.850516 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/563794dc-3226-4b76-83a8-e5992deda67a-service-ca\") pod \"console-5448fd56c5-qcvlr\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.852304 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.852286 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/563794dc-3226-4b76-83a8-e5992deda67a-console-serving-cert\") pod \"console-5448fd56c5-qcvlr\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.852393 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.852323 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/563794dc-3226-4b76-83a8-e5992deda67a-console-oauth-config\") pod \"console-5448fd56c5-qcvlr\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.852469 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.852451 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bd2d02c5-5aac-4af9-84af-6064147e26d6-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-z6jjd\" (UID: \"bd2d02c5-5aac-4af9-84af-6064147e26d6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-z6jjd" Jun 03 15:04:13.887420 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.887402 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jf4h\" (UniqueName: \"kubernetes.io/projected/b1623a8b-9473-4fe6-996e-864cd730ddfa-kube-api-access-8jf4h\") pod \"downloads-c65b8dc4b-7d9x6\" (UID: \"b1623a8b-9473-4fe6-996e-864cd730ddfa\") " pod="openshift-console/downloads-c65b8dc4b-7d9x6" Jun 03 15:04:13.898744 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.898724 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ppk4\" (UniqueName: \"kubernetes.io/projected/563794dc-3226-4b76-83a8-e5992deda67a-kube-api-access-7ppk4\") pod \"console-5448fd56c5-qcvlr\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.946898 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.946845 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:13.950841 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.950811 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54259166-c5f7-4ebf-9f36-206473a31278-data-volume\") pod \"insights-runtime-extractor-wrzg5\" (UID: \"54259166-c5f7-4ebf-9f36-206473a31278\") " pod="openshift-insights/insights-runtime-extractor-wrzg5" Jun 03 15:04:13.950940 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.950892 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54259166-c5f7-4ebf-9f36-206473a31278-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wrzg5\" (UID: \"54259166-c5f7-4ebf-9f36-206473a31278\") " pod="openshift-insights/insights-runtime-extractor-wrzg5" Jun 03 15:04:13.950940 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.950926 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54259166-c5f7-4ebf-9f36-206473a31278-crio-socket\") pod \"insights-runtime-extractor-wrzg5\" (UID: \"54259166-c5f7-4ebf-9f36-206473a31278\") " pod="openshift-insights/insights-runtime-extractor-wrzg5" Jun 03 15:04:13.951037 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.950997 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5m6s\" (UniqueName: \"kubernetes.io/projected/54259166-c5f7-4ebf-9f36-206473a31278-kube-api-access-w5m6s\") pod \"insights-runtime-extractor-wrzg5\" (UID: \"54259166-c5f7-4ebf-9f36-206473a31278\") " pod="openshift-insights/insights-runtime-extractor-wrzg5" Jun 03 15:04:13.951094 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.951033 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54259166-c5f7-4ebf-9f36-206473a31278-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wrzg5\" (UID: \"54259166-c5f7-4ebf-9f36-206473a31278\") " pod="openshift-insights/insights-runtime-extractor-wrzg5" Jun 03 15:04:13.951094 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.951056 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54259166-c5f7-4ebf-9f36-206473a31278-data-volume\") pod \"insights-runtime-extractor-wrzg5\" (UID: \"54259166-c5f7-4ebf-9f36-206473a31278\") " pod="openshift-insights/insights-runtime-extractor-wrzg5" Jun 03 15:04:13.951094 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.951083 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54259166-c5f7-4ebf-9f36-206473a31278-crio-socket\") pod \"insights-runtime-extractor-wrzg5\" (UID: \"54259166-c5f7-4ebf-9f36-206473a31278\") " pod="openshift-insights/insights-runtime-extractor-wrzg5" Jun 03 15:04:13.951582 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.951563 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54259166-c5f7-4ebf-9f36-206473a31278-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wrzg5\" (UID: \"54259166-c5f7-4ebf-9f36-206473a31278\") " pod="openshift-insights/insights-runtime-extractor-wrzg5" Jun 03 15:04:13.953071 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.953048 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54259166-c5f7-4ebf-9f36-206473a31278-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wrzg5\" (UID: \"54259166-c5f7-4ebf-9f36-206473a31278\") " pod="openshift-insights/insights-runtime-extractor-wrzg5" Jun 03 15:04:13.957933 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.957892 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-z6jjd" Jun 03 15:04:13.980125 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.980072 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-7d9x6" Jun 03 15:04:13.980506 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:13.980483 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5m6s\" (UniqueName: \"kubernetes.io/projected/54259166-c5f7-4ebf-9f36-206473a31278-kube-api-access-w5m6s\") pod \"insights-runtime-extractor-wrzg5\" (UID: \"54259166-c5f7-4ebf-9f36-206473a31278\") " pod="openshift-insights/insights-runtime-extractor-wrzg5" Jun 03 15:04:14.062628 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:14.062526 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wrzg5" Jun 03 15:04:14.159940 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:14.159900 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5448fd56c5-qcvlr"] Jun 03 15:04:14.179986 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:04:14.179940 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod563794dc_3226_4b76_83a8_e5992deda67a.slice/crio-b7d302eb34b54221c62d923f7ddfde8f9b2d93a43944469adebe6370d097b2b5 WatchSource:0}: Error finding container b7d302eb34b54221c62d923f7ddfde8f9b2d93a43944469adebe6370d097b2b5: Status 404 returned error can't find the container with id b7d302eb34b54221c62d923f7ddfde8f9b2d93a43944469adebe6370d097b2b5 Jun 03 15:04:14.216489 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:14.216418 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-7d9x6"] Jun 03 15:04:14.220008 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:04:14.219982 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1623a8b_9473_4fe6_996e_864cd730ddfa.slice/crio-7c076d2405278a2ac8de2c51fa9c154847f897fbce4872c751f6a7a7592bfab4 WatchSource:0}: Error finding container 7c076d2405278a2ac8de2c51fa9c154847f897fbce4872c751f6a7a7592bfab4: Status 404 returned error can't find the container with id 7c076d2405278a2ac8de2c51fa9c154847f897fbce4872c751f6a7a7592bfab4 Jun 03 15:04:14.230613 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:14.230591 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-z6jjd"] Jun 03 15:04:14.231979 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:04:14.231955 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd2d02c5_5aac_4af9_84af_6064147e26d6.slice/crio-8c1aaf9efbb4f61f773df4f0ca36b1b158c8728589b2c1d7c58adb0197bb9229 WatchSource:0}: Error finding container 8c1aaf9efbb4f61f773df4f0ca36b1b158c8728589b2c1d7c58adb0197bb9229: Status 404 returned error can't find the container with id 8c1aaf9efbb4f61f773df4f0ca36b1b158c8728589b2c1d7c58adb0197bb9229 Jun 03 15:04:14.252202 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:14.252179 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wrzg5"] Jun 03 15:04:14.253553 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:04:14.253530 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54259166_c5f7_4ebf_9f36_206473a31278.slice/crio-c24a20dc1565b5248f84be4362e10ba29699a6405932243cd636e6f7767ffe46 WatchSource:0}: Error finding container c24a20dc1565b5248f84be4362e10ba29699a6405932243cd636e6f7767ffe46: Status 404 returned error can't find the container with id c24a20dc1565b5248f84be4362e10ba29699a6405932243cd636e6f7767ffe46 Jun 03 15:04:14.727954 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:14.727919 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wrzg5" event={"ID":"54259166-c5f7-4ebf-9f36-206473a31278","Type":"ContainerStarted","Data":"87e95c9ee559568ae6577743d486e48068accef7ad96ae0786b78cb2d9ba2d99"} Jun 03 15:04:14.727954 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:14.727958 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wrzg5" event={"ID":"54259166-c5f7-4ebf-9f36-206473a31278","Type":"ContainerStarted","Data":"c24a20dc1565b5248f84be4362e10ba29699a6405932243cd636e6f7767ffe46"} Jun 03 15:04:14.729009 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:14.728985 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-7d9x6" event={"ID":"b1623a8b-9473-4fe6-996e-864cd730ddfa","Type":"ContainerStarted","Data":"7c076d2405278a2ac8de2c51fa9c154847f897fbce4872c751f6a7a7592bfab4"} Jun 03 15:04:14.729940 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:14.729921 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5448fd56c5-qcvlr" event={"ID":"563794dc-3226-4b76-83a8-e5992deda67a","Type":"ContainerStarted","Data":"b7d302eb34b54221c62d923f7ddfde8f9b2d93a43944469adebe6370d097b2b5"} Jun 03 15:04:14.730904 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:14.730884 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-z6jjd" event={"ID":"bd2d02c5-5aac-4af9-84af-6064147e26d6","Type":"ContainerStarted","Data":"8c1aaf9efbb4f61f773df4f0ca36b1b158c8728589b2c1d7c58adb0197bb9229"} Jun 03 15:04:15.704505 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:15.704471 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gbhfn" Jun 03 15:04:16.739306 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:16.739259 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wrzg5" event={"ID":"54259166-c5f7-4ebf-9f36-206473a31278","Type":"ContainerStarted","Data":"a0864608ee68ca1a69c7b6448ebb39c8b792174a9728249885ff34cc0cbba2fc"} Jun 03 15:04:16.740768 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:16.740737 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-z6jjd" event={"ID":"bd2d02c5-5aac-4af9-84af-6064147e26d6","Type":"ContainerStarted","Data":"1ae0850f65eddd8f3d65e9b62129a1d7026e3165f2c2ce937dc4002f20c88e3a"} Jun 03 15:04:16.741188 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:16.741166 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-z6jjd" Jun 03 15:04:16.747264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:16.747240 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-z6jjd" Jun 03 15:04:16.771141 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:16.771085 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-z6jjd" podStartSLOduration=2.000382913 podStartE2EDuration="3.771069596s" podCreationTimestamp="2026-06-03 15:04:13 +0000 UTC" firstStartedPulling="2026-06-03 15:04:14.233757995 +0000 UTC m=+81.586727998" lastFinishedPulling="2026-06-03 15:04:16.004444664 +0000 UTC m=+83.357414681" observedRunningTime="2026-06-03 15:04:16.767600412 +0000 UTC m=+84.120570443" watchObservedRunningTime="2026-06-03 15:04:16.771069596 +0000 UTC m=+84.124039622" Jun 03 15:04:17.549593 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.549112 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r"] Jun 03 15:04:17.568274 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.568220 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b787ccb4b-pzbmg"] Jun 03 15:04:17.568468 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.568427 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" Jun 03 15:04:17.575502 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.575319 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xj8rn\"" Jun 03 15:04:17.575654 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.575502 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 03 15:04:17.575654 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.575513 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 15:04:17.582023 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.581973 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 03 15:04:17.582598 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.582577 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.626240 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.625617 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 15:04:17.626678 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.626647 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r"] Jun 03 15:04:17.626794 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.626692 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b787ccb4b-pzbmg"] Jun 03 15:04:17.689659 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.689580 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-trusted-ca-bundle\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.689659 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.689632 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-console-config\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.689896 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.689666 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f934a9b-8542-412e-84b3-bb23a646d85b-console-oauth-config\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.689896 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.689699 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f687314-29b5-4b7a-8db5-f86fb4033be0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-9js9r\" (UID: \"8f687314-29b5-4b7a-8db5-f86fb4033be0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" Jun 03 15:04:17.689896 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.689749 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-service-ca\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.689896 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.689802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f934a9b-8542-412e-84b3-bb23a646d85b-console-serving-cert\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.689896 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.689828 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6ssw\" (UniqueName: \"kubernetes.io/projected/8f934a9b-8542-412e-84b3-bb23a646d85b-kube-api-access-f6ssw\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.689896 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.689851 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk65w\" (UniqueName: \"kubernetes.io/projected/8f687314-29b5-4b7a-8db5-f86fb4033be0-kube-api-access-tk65w\") pod \"prometheus-operator-658bcd8bdf-9js9r\" (UID: \"8f687314-29b5-4b7a-8db5-f86fb4033be0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" Jun 03 15:04:17.689896 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.689896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f687314-29b5-4b7a-8db5-f86fb4033be0-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-9js9r\" (UID: \"8f687314-29b5-4b7a-8db5-f86fb4033be0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" Jun 03 15:04:17.690246 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.689941 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f687314-29b5-4b7a-8db5-f86fb4033be0-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-9js9r\" (UID: \"8f687314-29b5-4b7a-8db5-f86fb4033be0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" Jun 03 15:04:17.690246 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.689972 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-oauth-serving-cert\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.790570 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.790507 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f934a9b-8542-412e-84b3-bb23a646d85b-console-serving-cert\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.790570 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.790562 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f6ssw\" (UniqueName: \"kubernetes.io/projected/8f934a9b-8542-412e-84b3-bb23a646d85b-kube-api-access-f6ssw\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.791070 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.790592 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tk65w\" (UniqueName: \"kubernetes.io/projected/8f687314-29b5-4b7a-8db5-f86fb4033be0-kube-api-access-tk65w\") pod \"prometheus-operator-658bcd8bdf-9js9r\" (UID: \"8f687314-29b5-4b7a-8db5-f86fb4033be0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" Jun 03 15:04:17.791070 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.790645 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f687314-29b5-4b7a-8db5-f86fb4033be0-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-9js9r\" (UID: \"8f687314-29b5-4b7a-8db5-f86fb4033be0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" Jun 03 15:04:17.791070 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.790701 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f687314-29b5-4b7a-8db5-f86fb4033be0-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-9js9r\" (UID: \"8f687314-29b5-4b7a-8db5-f86fb4033be0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" Jun 03 15:04:17.791070 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.790732 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-oauth-serving-cert\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.791070 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.790767 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-trusted-ca-bundle\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.791070 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.790803 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-console-config\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.791070 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.790839 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f934a9b-8542-412e-84b3-bb23a646d85b-console-oauth-config\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.791070 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:04:17.790874 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 03 15:04:17.791070 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:04:17.790933 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f687314-29b5-4b7a-8db5-f86fb4033be0-prometheus-operator-tls podName:8f687314-29b5-4b7a-8db5-f86fb4033be0 nodeName:}" failed. No retries permitted until 2026-06-03 15:04:18.290912832 +0000 UTC m=+85.643882853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8f687314-29b5-4b7a-8db5-f86fb4033be0-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-9js9r" (UID: "8f687314-29b5-4b7a-8db5-f86fb4033be0") : secret "prometheus-operator-tls" not found Jun 03 15:04:17.791070 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.790875 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f687314-29b5-4b7a-8db5-f86fb4033be0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-9js9r\" (UID: \"8f687314-29b5-4b7a-8db5-f86fb4033be0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" Jun 03 15:04:17.791070 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.791059 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-service-ca\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.791980 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.791929 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f687314-29b5-4b7a-8db5-f86fb4033be0-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-9js9r\" (UID: \"8f687314-29b5-4b7a-8db5-f86fb4033be0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" Jun 03 15:04:17.792359 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.792335 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-trusted-ca-bundle\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.793151 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.792567 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-console-config\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.793151 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.793002 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-service-ca\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.793151 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.793108 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-oauth-serving-cert\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.793920 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.793876 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f687314-29b5-4b7a-8db5-f86fb4033be0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-9js9r\" (UID: \"8f687314-29b5-4b7a-8db5-f86fb4033be0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" Jun 03 15:04:17.794301 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.794276 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f934a9b-8542-412e-84b3-bb23a646d85b-console-serving-cert\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.794439 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.794274 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f934a9b-8542-412e-84b3-bb23a646d85b-console-oauth-config\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.813126 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.813030 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6ssw\" (UniqueName: \"kubernetes.io/projected/8f934a9b-8542-412e-84b3-bb23a646d85b-kube-api-access-f6ssw\") pod \"console-7b787ccb4b-pzbmg\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:17.814096 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.814073 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk65w\" (UniqueName: \"kubernetes.io/projected/8f687314-29b5-4b7a-8db5-f86fb4033be0-kube-api-access-tk65w\") pod \"prometheus-operator-658bcd8bdf-9js9r\" (UID: \"8f687314-29b5-4b7a-8db5-f86fb4033be0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" Jun 03 15:04:17.894315 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:17.893904 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:18.295783 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:18.295740 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f687314-29b5-4b7a-8db5-f86fb4033be0-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-9js9r\" (UID: \"8f687314-29b5-4b7a-8db5-f86fb4033be0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" Jun 03 15:04:18.298174 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:18.298152 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8f687314-29b5-4b7a-8db5-f86fb4033be0-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-9js9r\" (UID: \"8f687314-29b5-4b7a-8db5-f86fb4033be0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" Jun 03 15:04:18.479837 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:18.479795 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" Jun 03 15:04:19.578881 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:19.578823 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b787ccb4b-pzbmg"] Jun 03 15:04:19.582322 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:04:19.582293 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f934a9b_8542_412e_84b3_bb23a646d85b.slice/crio-0b17566cfcd59a9f9fb1806721fd27d938c1343e85634187eb485e796ebd5c5a WatchSource:0}: Error finding container 0b17566cfcd59a9f9fb1806721fd27d938c1343e85634187eb485e796ebd5c5a: Status 404 returned error can't find the container with id 0b17566cfcd59a9f9fb1806721fd27d938c1343e85634187eb485e796ebd5c5a Jun 03 15:04:19.606927 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:19.606904 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r"] Jun 03 15:04:19.608731 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:04:19.608706 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f687314_29b5_4b7a_8db5_f86fb4033be0.slice/crio-a44875f93402f40bf64302eca60e7d814175062878568a2ac2df544331bdf0b5 WatchSource:0}: Error finding container a44875f93402f40bf64302eca60e7d814175062878568a2ac2df544331bdf0b5: Status 404 returned error can't find the container with id a44875f93402f40bf64302eca60e7d814175062878568a2ac2df544331bdf0b5 Jun 03 15:04:19.754189 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:19.754151 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wrzg5" event={"ID":"54259166-c5f7-4ebf-9f36-206473a31278","Type":"ContainerStarted","Data":"432df448367e55791ab5eaefae0ed697a755e46ee951a3298e470373b3072ae7"} Jun 03 15:04:19.755583 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:19.755538 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" event={"ID":"8f687314-29b5-4b7a-8db5-f86fb4033be0","Type":"ContainerStarted","Data":"a44875f93402f40bf64302eca60e7d814175062878568a2ac2df544331bdf0b5"} Jun 03 15:04:19.757505 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:19.757471 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b787ccb4b-pzbmg" event={"ID":"8f934a9b-8542-412e-84b3-bb23a646d85b","Type":"ContainerStarted","Data":"438d2ae296c33de3cfd5d1e0937f680bb50090f36566a5af4727d62432f454c6"} Jun 03 15:04:19.757505 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:19.757504 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b787ccb4b-pzbmg" event={"ID":"8f934a9b-8542-412e-84b3-bb23a646d85b","Type":"ContainerStarted","Data":"0b17566cfcd59a9f9fb1806721fd27d938c1343e85634187eb485e796ebd5c5a"} Jun 03 15:04:19.759170 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:19.759132 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5448fd56c5-qcvlr" event={"ID":"563794dc-3226-4b76-83a8-e5992deda67a","Type":"ContainerStarted","Data":"286b3c2ea190b323b0ea514779eddb55deba40666580a6a8003384434124ccf1"} Jun 03 15:04:19.795605 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:19.795546 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wrzg5" podStartSLOduration=1.764996998 podStartE2EDuration="6.795527545s" podCreationTimestamp="2026-06-03 15:04:13 +0000 UTC" firstStartedPulling="2026-06-03 15:04:14.37004734 +0000 UTC m=+81.723017358" lastFinishedPulling="2026-06-03 15:04:19.400577896 +0000 UTC m=+86.753547905" observedRunningTime="2026-06-03 15:04:19.794257855 +0000 UTC m=+87.147227882" watchObservedRunningTime="2026-06-03 15:04:19.795527545 +0000 UTC m=+87.148497572" Jun 03 15:04:19.831041 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:19.830987 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7b787ccb4b-pzbmg" podStartSLOduration=2.830971491 podStartE2EDuration="2.830971491s" podCreationTimestamp="2026-06-03 15:04:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:04:19.830005945 +0000 UTC m=+87.182975971" watchObservedRunningTime="2026-06-03 15:04:19.830971491 +0000 UTC m=+87.183941517" Jun 03 15:04:19.862683 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:19.862629 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5448fd56c5-qcvlr" podStartSLOduration=1.646851754 podStartE2EDuration="6.862612158s" podCreationTimestamp="2026-06-03 15:04:13 +0000 UTC" firstStartedPulling="2026-06-03 15:04:14.182528013 +0000 UTC m=+81.535498018" lastFinishedPulling="2026-06-03 15:04:19.398288412 +0000 UTC m=+86.751258422" observedRunningTime="2026-06-03 15:04:19.861411527 +0000 UTC m=+87.214381553" watchObservedRunningTime="2026-06-03 15:04:19.862612158 +0000 UTC m=+87.215582181" Jun 03 15:04:20.128242 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:20.128210 2577 patch_prober.go:28] interesting pod/image-registry-774f88d448-wpp89 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 15:04:20.128402 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:20.128260 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-774f88d448-wpp89" podUID="866c3310-011a-4ab6-b677-93e8eeabd1d6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 15:04:21.682086 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:21.682060 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:04:21.771950 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:21.771913 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" event={"ID":"8f687314-29b5-4b7a-8db5-f86fb4033be0","Type":"ContainerStarted","Data":"2b151124665ebb6c8b007edf80fcfcbb865169d64613c1079fd27063c714f099"} Jun 03 15:04:21.772121 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:21.771959 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" event={"ID":"8f687314-29b5-4b7a-8db5-f86fb4033be0","Type":"ContainerStarted","Data":"eb359a592a0b3c7bb330cde27f2d693bf0b2af401f364b51692a407148031b35"} Jun 03 15:04:21.810332 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:21.810265 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-9js9r" podStartSLOduration=2.954492276 podStartE2EDuration="4.810244466s" podCreationTimestamp="2026-06-03 15:04:17 +0000 UTC" firstStartedPulling="2026-06-03 15:04:19.610443772 +0000 UTC m=+86.963413776" lastFinishedPulling="2026-06-03 15:04:21.466195947 +0000 UTC m=+88.819165966" observedRunningTime="2026-06-03 15:04:21.808768434 +0000 UTC m=+89.161738461" watchObservedRunningTime="2026-06-03 15:04:21.810244466 +0000 UTC m=+89.163214493" Jun 03 15:04:23.678218 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:23.678188 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:04:23.948257 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:23.947538 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:23.948257 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:23.947712 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:23.955775 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:23.955749 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:24.007276 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.007195 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kwcfx"] Jun 03 15:04:24.036406 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.036014 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.044554 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.044016 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x69pg\"" Jun 03 15:04:24.044554 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.044235 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 15:04:24.044554 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.044411 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 15:04:24.061144 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.060946 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 15:04:24.162571 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.162526 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-root\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.162736 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.162582 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.162736 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.162701 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-tls\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.162853 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.162753 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-wtmp\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.162853 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.162797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-metrics-client-ca\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.162853 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.162824 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.163006 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.162875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-textfile\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.163006 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.162927 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-sys\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.163006 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.162963 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kh55\" (UniqueName: \"kubernetes.io/projected/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-kube-api-access-8kh55\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.264035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.263954 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-root\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.264035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.264008 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.264255 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.264070 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-tls\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.264255 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.264104 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-wtmp\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.264255 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.264143 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-metrics-client-ca\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.264255 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.264148 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-root\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.264255 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.264168 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.264255 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.264221 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-textfile\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.264255 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.264250 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-sys\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.264781 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.264278 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8kh55\" (UniqueName: \"kubernetes.io/projected/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-kube-api-access-8kh55\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.264781 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.264309 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-wtmp\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.264781 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.264384 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-sys\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.264885 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.264813 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-textfile\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.265038 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.264976 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-metrics-client-ca\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.265146 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:04:24.265102 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 15:04:24.265146 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.265114 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.265250 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:04:24.265169 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-tls podName:e8af208a-fc42-4fcd-86a8-07b0dc6182ad nodeName:}" failed. No retries permitted until 2026-06-03 15:04:24.765150278 +0000 UTC m=+92.118120284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-tls") pod "node-exporter-kwcfx" (UID: "e8af208a-fc42-4fcd-86a8-07b0dc6182ad") : secret "node-exporter-tls" not found Jun 03 15:04:24.266993 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.266969 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.275490 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.275466 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kh55\" (UniqueName: \"kubernetes.io/projected/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-kube-api-access-8kh55\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.770656 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.770609 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-tls\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:24.771113 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:04:24.770783 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 15:04:24.771113 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:04:24.770906 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-tls podName:e8af208a-fc42-4fcd-86a8-07b0dc6182ad nodeName:}" failed. No retries permitted until 2026-06-03 15:04:25.770881154 +0000 UTC m=+93.123851176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-tls") pod "node-exporter-kwcfx" (UID: "e8af208a-fc42-4fcd-86a8-07b0dc6182ad") : secret "node-exporter-tls" not found Jun 03 15:04:24.787847 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:24.787818 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:25.783671 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:25.783636 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-tls\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:25.786247 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:25.786223 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8af208a-fc42-4fcd-86a8-07b0dc6182ad-node-exporter-tls\") pod \"node-exporter-kwcfx\" (UID: \"e8af208a-fc42-4fcd-86a8-07b0dc6182ad\") " pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:25.852043 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:25.852008 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kwcfx" Jun 03 15:04:25.864183 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:04:25.864148 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8af208a_fc42_4fcd_86a8_07b0dc6182ad.slice/crio-c859c74f0c27262e97e8ecfbd47501e60f10cd24b68df401decf1edf30c967d1 WatchSource:0}: Error finding container c859c74f0c27262e97e8ecfbd47501e60f10cd24b68df401decf1edf30c967d1: Status 404 returned error can't find the container with id c859c74f0c27262e97e8ecfbd47501e60f10cd24b68df401decf1edf30c967d1 Jun 03 15:04:26.793120 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:26.793048 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kwcfx" event={"ID":"e8af208a-fc42-4fcd-86a8-07b0dc6182ad","Type":"ContainerStarted","Data":"c859c74f0c27262e97e8ecfbd47501e60f10cd24b68df401decf1edf30c967d1"} Jun 03 15:04:27.798205 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:27.798175 2577 generic.go:358] "Generic (PLEG): container finished" podID="e8af208a-fc42-4fcd-86a8-07b0dc6182ad" containerID="6675e9dc169ec78b5ac7da65733b7d29aafd6919aec8a83a9df8fdcd0c03e94a" exitCode=0 Jun 03 15:04:27.798587 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:27.798274 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kwcfx" event={"ID":"e8af208a-fc42-4fcd-86a8-07b0dc6182ad","Type":"ContainerDied","Data":"6675e9dc169ec78b5ac7da65733b7d29aafd6919aec8a83a9df8fdcd0c03e94a"} Jun 03 15:04:27.894482 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:27.894446 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:27.894647 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:27.894497 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:27.900917 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:27.900864 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:28.806481 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:28.806450 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:04:28.898705 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:28.898668 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5448fd56c5-qcvlr"] Jun 03 15:04:29.891804 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:29.891773 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d8769d8d4-hpk47"] Jun 03 15:04:29.894785 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:29.894764 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:29.907191 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:29.907170 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d8769d8d4-hpk47"] Jun 03 15:04:29.924961 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:29.924929 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-trusted-ca-bundle\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:29.925101 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:29.924973 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcchv\" (UniqueName: \"kubernetes.io/projected/67d27999-9a35-4b68-a20b-8b14efce4e3e-kube-api-access-pcchv\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:29.925101 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:29.925049 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67d27999-9a35-4b68-a20b-8b14efce4e3e-console-oauth-config\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:29.925101 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:29.925093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-console-config\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:29.925261 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:29.925119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-service-ca\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:29.925261 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:29.925233 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-oauth-serving-cert\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:29.925357 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:29.925278 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67d27999-9a35-4b68-a20b-8b14efce4e3e-console-serving-cert\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:30.026040 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:30.026001 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-trusted-ca-bundle\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:30.026240 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:30.026048 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcchv\" (UniqueName: \"kubernetes.io/projected/67d27999-9a35-4b68-a20b-8b14efce4e3e-kube-api-access-pcchv\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:30.026240 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:30.026090 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67d27999-9a35-4b68-a20b-8b14efce4e3e-console-oauth-config\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:30.026240 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:30.026117 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-console-config\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:30.026240 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:30.026138 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-service-ca\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:30.026240 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:30.026212 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-oauth-serving-cert\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:30.026542 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:30.026244 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67d27999-9a35-4b68-a20b-8b14efce4e3e-console-serving-cert\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:30.027054 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:30.026940 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-console-config\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:30.027054 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:30.026991 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-oauth-serving-cert\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:30.027223 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:30.027095 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-trusted-ca-bundle\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:30.027223 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:30.027130 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-service-ca\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:30.028865 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:30.028845 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67d27999-9a35-4b68-a20b-8b14efce4e3e-console-oauth-config\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:30.029661 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:30.029621 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67d27999-9a35-4b68-a20b-8b14efce4e3e-console-serving-cert\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:30.035596 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:30.035572 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcchv\" (UniqueName: \"kubernetes.io/projected/67d27999-9a35-4b68-a20b-8b14efce4e3e-kube-api-access-pcchv\") pod \"console-5d8769d8d4-hpk47\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:30.206998 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:30.206900 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:30.667538 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:30.667496 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6wc5f" Jun 03 15:04:33.650536 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.650497 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d8769d8d4-hpk47"] Jun 03 15:04:33.777155 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.777117 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d497cb9dc-ps8rk"] Jun 03 15:04:33.780849 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.780825 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.805052 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.805019 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d497cb9dc-ps8rk"] Jun 03 15:04:33.867716 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.867683 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6af43e4d-9145-4786-b79f-fb57ce780841-console-oauth-config\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.867895 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.867745 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-trusted-ca-bundle\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.867895 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.867776 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-oauth-serving-cert\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.867895 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.867821 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-service-ca\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.867895 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.867874 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6af43e4d-9145-4786-b79f-fb57ce780841-console-serving-cert\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.868117 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.867970 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6c78\" (UniqueName: \"kubernetes.io/projected/6af43e4d-9145-4786-b79f-fb57ce780841-kube-api-access-w6c78\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.868117 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.868004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-console-config\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.969590 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.969503 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6af43e4d-9145-4786-b79f-fb57ce780841-console-serving-cert\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.969590 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.969581 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6c78\" (UniqueName: \"kubernetes.io/projected/6af43e4d-9145-4786-b79f-fb57ce780841-kube-api-access-w6c78\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.969815 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.969626 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-console-config\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.969815 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.969711 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6af43e4d-9145-4786-b79f-fb57ce780841-console-oauth-config\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.969815 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.969774 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-trusted-ca-bundle\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.969950 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.969879 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-oauth-serving-cert\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.969950 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.969934 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-service-ca\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.970755 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.970501 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-console-config\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.970755 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.970683 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-service-ca\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.970755 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.970712 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-oauth-serving-cert\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.970755 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.970757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-trusted-ca-bundle\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.972563 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.972531 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6af43e4d-9145-4786-b79f-fb57ce780841-console-serving-cert\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.972731 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.972708 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6af43e4d-9145-4786-b79f-fb57ce780841-console-oauth-config\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:33.983938 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:33.983916 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6c78\" (UniqueName: \"kubernetes.io/projected/6af43e4d-9145-4786-b79f-fb57ce780841-kube-api-access-w6c78\") pod \"console-6d497cb9dc-ps8rk\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:34.093049 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:34.092997 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:35.249232 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:35.249202 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d497cb9dc-ps8rk"] Jun 03 15:04:35.254158 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:04:35.254131 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af43e4d_9145_4786_b79f_fb57ce780841.slice/crio-9644482f5a4f86b776358dce1fe685c252ea4e21bb966eafdeb37ee13b71f4ea WatchSource:0}: Error finding container 9644482f5a4f86b776358dce1fe685c252ea4e21bb966eafdeb37ee13b71f4ea: Status 404 returned error can't find the container with id 9644482f5a4f86b776358dce1fe685c252ea4e21bb966eafdeb37ee13b71f4ea Jun 03 15:04:35.263892 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:35.263870 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d8769d8d4-hpk47"] Jun 03 15:04:35.266762 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:04:35.266739 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67d27999_9a35_4b68_a20b_8b14efce4e3e.slice/crio-1ecb28580942b63e48ddf3871e558a9e395a2092a09b197e634d3e87ea0a58ed WatchSource:0}: Error finding container 1ecb28580942b63e48ddf3871e558a9e395a2092a09b197e634d3e87ea0a58ed: Status 404 returned error can't find the container with id 1ecb28580942b63e48ddf3871e558a9e395a2092a09b197e634d3e87ea0a58ed Jun 03 15:04:35.832180 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:35.832147 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-7d9x6" event={"ID":"b1623a8b-9473-4fe6-996e-864cd730ddfa","Type":"ContainerStarted","Data":"b68624626198ff099ed77111b8b0b5db61535585cc3e7b824df69aa1e7457e66"} Jun 03 15:04:35.832357 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:35.832338 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-7d9x6" Jun 03 15:04:35.833616 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:35.833592 2577 patch_prober.go:28] interesting pod/downloads-c65b8dc4b-7d9x6 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.27:8080/\": dial tcp 10.132.0.27:8080: connect: connection refused" start-of-body= Jun 03 15:04:35.833718 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:35.833636 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-c65b8dc4b-7d9x6" podUID="b1623a8b-9473-4fe6-996e-864cd730ddfa" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.27:8080/\": dial tcp 10.132.0.27:8080: connect: connection refused" Jun 03 15:04:35.834424 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:35.834395 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kwcfx" event={"ID":"e8af208a-fc42-4fcd-86a8-07b0dc6182ad","Type":"ContainerStarted","Data":"b248f78de7dc90f54c7b9a30d981f28a5ed72632775d07bdb023b26f224642d3"} Jun 03 15:04:35.834549 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:35.834433 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kwcfx" event={"ID":"e8af208a-fc42-4fcd-86a8-07b0dc6182ad","Type":"ContainerStarted","Data":"9c3fb1b8ee8bc2430fa9b2ca33826ed9e7e84abd08ad34546f7abd3520762462"} Jun 03 15:04:35.835903 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:35.835871 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d497cb9dc-ps8rk" event={"ID":"6af43e4d-9145-4786-b79f-fb57ce780841","Type":"ContainerStarted","Data":"f55bea3ddace8373506ae7229d52ab8904c6a01304f11cf594100cf94113b902"} Jun 03 15:04:35.835979 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:35.835916 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d497cb9dc-ps8rk" event={"ID":"6af43e4d-9145-4786-b79f-fb57ce780841","Type":"ContainerStarted","Data":"9644482f5a4f86b776358dce1fe685c252ea4e21bb966eafdeb37ee13b71f4ea"} Jun 03 15:04:35.837309 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:35.837287 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8769d8d4-hpk47" event={"ID":"67d27999-9a35-4b68-a20b-8b14efce4e3e","Type":"ContainerStarted","Data":"553c9f28b32022597c7223c2a9c1659d6368bba24cdca60bf3f32b15fd625380"} Jun 03 15:04:35.837421 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:35.837318 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8769d8d4-hpk47" event={"ID":"67d27999-9a35-4b68-a20b-8b14efce4e3e","Type":"ContainerStarted","Data":"1ecb28580942b63e48ddf3871e558a9e395a2092a09b197e634d3e87ea0a58ed"} Jun 03 15:04:35.857001 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:35.856919 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-7d9x6" podStartSLOduration=1.5523770030000001 podStartE2EDuration="22.856905868s" podCreationTimestamp="2026-06-03 15:04:13 +0000 UTC" firstStartedPulling="2026-06-03 15:04:14.221904328 +0000 UTC m=+81.574874332" lastFinishedPulling="2026-06-03 15:04:35.526433189 +0000 UTC m=+102.879403197" observedRunningTime="2026-06-03 15:04:35.855053202 +0000 UTC m=+103.208023228" watchObservedRunningTime="2026-06-03 15:04:35.856905868 +0000 UTC m=+103.209875894" Jun 03 15:04:35.882406 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:35.882355 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kwcfx" podStartSLOduration=11.634397503 podStartE2EDuration="12.882344665s" podCreationTimestamp="2026-06-03 15:04:23 +0000 UTC" firstStartedPulling="2026-06-03 15:04:25.866254889 +0000 UTC m=+93.219224894" lastFinishedPulling="2026-06-03 15:04:27.114202037 +0000 UTC m=+94.467172056" observedRunningTime="2026-06-03 15:04:35.88146612 +0000 UTC m=+103.234436146" watchObservedRunningTime="2026-06-03 15:04:35.882344665 +0000 UTC m=+103.235314688" Jun 03 15:04:35.909278 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:35.909233 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6d497cb9dc-ps8rk" podStartSLOduration=2.909217923 podStartE2EDuration="2.909217923s" podCreationTimestamp="2026-06-03 15:04:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:04:35.90883953 +0000 UTC m=+103.261809579" watchObservedRunningTime="2026-06-03 15:04:35.909217923 +0000 UTC m=+103.262187951" Jun 03 15:04:35.938717 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:35.938680 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5d8769d8d4-hpk47" podStartSLOduration=6.938670488 podStartE2EDuration="6.938670488s" podCreationTimestamp="2026-06-03 15:04:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:04:35.938018674 +0000 UTC m=+103.290988701" watchObservedRunningTime="2026-06-03 15:04:35.938670488 +0000 UTC m=+103.291640512" Jun 03 15:04:36.858346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:36.858314 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-7d9x6" Jun 03 15:04:38.691844 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:38.691793 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-bb8d97579-px8fb" podUID="f5cc1a7b-de22-4984-94d2-a6c717d2acf3" containerName="registry" containerID="cri-o://b39395ee8a3d089b05489db4951ccc1c9f540957459d5ace9a6c846309550b65" gracePeriod=30 Jun 03 15:04:38.854006 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:38.853879 2577 generic.go:358] "Generic (PLEG): container finished" podID="f5cc1a7b-de22-4984-94d2-a6c717d2acf3" containerID="b39395ee8a3d089b05489db4951ccc1c9f540957459d5ace9a6c846309550b65" exitCode=0 Jun 03 15:04:38.854006 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:38.853964 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bb8d97579-px8fb" event={"ID":"f5cc1a7b-de22-4984-94d2-a6c717d2acf3","Type":"ContainerDied","Data":"b39395ee8a3d089b05489db4951ccc1c9f540957459d5ace9a6c846309550b65"} Jun 03 15:04:38.978812 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:38.978786 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:04:39.022332 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.022298 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpqjd\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-kube-api-access-lpqjd\") pod \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " Jun 03 15:04:39.022503 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.022344 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-certificates\") pod \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " Jun 03 15:04:39.022503 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.022407 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-image-registry-private-configuration\") pod \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " Jun 03 15:04:39.022503 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.022440 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls\") pod \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " Jun 03 15:04:39.022503 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.022493 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-trusted-ca\") pod \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " Jun 03 15:04:39.022813 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.022551 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-ca-trust-extracted\") pod \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " Jun 03 15:04:39.022813 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.022649 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-bound-sa-token\") pod \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " Jun 03 15:04:39.022813 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.022675 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-installation-pull-secrets\") pod \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\" (UID: \"f5cc1a7b-de22-4984-94d2-a6c717d2acf3\") " Jun 03 15:04:39.022950 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.022820 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f5cc1a7b-de22-4984-94d2-a6c717d2acf3" (UID: "f5cc1a7b-de22-4984-94d2-a6c717d2acf3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:04:39.023503 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.023045 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-certificates\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:04:39.023622 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.023548 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f5cc1a7b-de22-4984-94d2-a6c717d2acf3" (UID: "f5cc1a7b-de22-4984-94d2-a6c717d2acf3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:04:39.025855 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.025814 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f5cc1a7b-de22-4984-94d2-a6c717d2acf3" (UID: "f5cc1a7b-de22-4984-94d2-a6c717d2acf3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:04:39.026120 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.026093 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f5cc1a7b-de22-4984-94d2-a6c717d2acf3" (UID: "f5cc1a7b-de22-4984-94d2-a6c717d2acf3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:04:39.026959 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.026902 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f5cc1a7b-de22-4984-94d2-a6c717d2acf3" (UID: "f5cc1a7b-de22-4984-94d2-a6c717d2acf3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:04:39.027582 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.027547 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-kube-api-access-lpqjd" (OuterVolumeSpecName: "kube-api-access-lpqjd") pod "f5cc1a7b-de22-4984-94d2-a6c717d2acf3" (UID: "f5cc1a7b-de22-4984-94d2-a6c717d2acf3"). InnerVolumeSpecName "kube-api-access-lpqjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:04:39.029389 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.029293 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f5cc1a7b-de22-4984-94d2-a6c717d2acf3" (UID: "f5cc1a7b-de22-4984-94d2-a6c717d2acf3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:04:39.035990 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.035963 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f5cc1a7b-de22-4984-94d2-a6c717d2acf3" (UID: "f5cc1a7b-de22-4984-94d2-a6c717d2acf3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:04:39.123961 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.123935 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-bound-sa-token\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:04:39.123961 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.123958 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-installation-pull-secrets\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:04:39.124178 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.123968 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpqjd\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-kube-api-access-lpqjd\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:04:39.124178 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.123978 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-image-registry-private-configuration\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:04:39.124178 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.123988 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-registry-tls\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:04:39.124178 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.123997 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-trusted-ca\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:04:39.124178 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.124010 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f5cc1a7b-de22-4984-94d2-a6c717d2acf3-ca-trust-extracted\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:04:39.858933 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.858899 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb8d97579-px8fb" Jun 03 15:04:39.858933 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.858922 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bb8d97579-px8fb" event={"ID":"f5cc1a7b-de22-4984-94d2-a6c717d2acf3","Type":"ContainerDied","Data":"0b83d9454ab3ca870dd46855ad24b2ee6f72f792b56976fe6b4a62eedc21875b"} Jun 03 15:04:39.859577 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.858975 2577 scope.go:117] "RemoveContainer" containerID="b39395ee8a3d089b05489db4951ccc1c9f540957459d5ace9a6c846309550b65" Jun 03 15:04:39.882716 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.882686 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bb8d97579-px8fb"] Jun 03 15:04:39.888911 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:39.888872 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-bb8d97579-px8fb"] Jun 03 15:04:40.207237 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:40.207148 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:04:40.893551 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:40.893516 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-774f88d448-wpp89"] Jun 03 15:04:41.245251 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:41.245159 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5cc1a7b-de22-4984-94d2-a6c717d2acf3" path="/var/lib/kubelet/pods/f5cc1a7b-de22-4984-94d2-a6c717d2acf3/volumes" Jun 03 15:04:44.093171 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:44.093135 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:44.093628 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:44.093193 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:44.098721 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:44.098693 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:44.881852 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:44.881820 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:04:44.947696 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:44.947667 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b787ccb4b-pzbmg"] Jun 03 15:04:53.925714 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:53.925652 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5448fd56c5-qcvlr" podUID="563794dc-3226-4b76-83a8-e5992deda67a" containerName="console" containerID="cri-o://286b3c2ea190b323b0ea514779eddb55deba40666580a6a8003384434124ccf1" gracePeriod=15 Jun 03 15:04:54.260599 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.260573 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5448fd56c5-qcvlr_563794dc-3226-4b76-83a8-e5992deda67a/console/0.log" Jun 03 15:04:54.260729 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.260638 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:54.377163 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.377131 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/563794dc-3226-4b76-83a8-e5992deda67a-service-ca\") pod \"563794dc-3226-4b76-83a8-e5992deda67a\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " Jun 03 15:04:54.377340 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.377185 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/563794dc-3226-4b76-83a8-e5992deda67a-console-oauth-config\") pod \"563794dc-3226-4b76-83a8-e5992deda67a\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " Jun 03 15:04:54.377340 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.377215 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ppk4\" (UniqueName: \"kubernetes.io/projected/563794dc-3226-4b76-83a8-e5992deda67a-kube-api-access-7ppk4\") pod \"563794dc-3226-4b76-83a8-e5992deda67a\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " Jun 03 15:04:54.377340 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.377243 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/563794dc-3226-4b76-83a8-e5992deda67a-oauth-serving-cert\") pod \"563794dc-3226-4b76-83a8-e5992deda67a\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " Jun 03 15:04:54.377340 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.377301 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/563794dc-3226-4b76-83a8-e5992deda67a-console-config\") pod \"563794dc-3226-4b76-83a8-e5992deda67a\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " Jun 03 15:04:54.377340 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.377325 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/563794dc-3226-4b76-83a8-e5992deda67a-console-serving-cert\") pod \"563794dc-3226-4b76-83a8-e5992deda67a\" (UID: \"563794dc-3226-4b76-83a8-e5992deda67a\") " Jun 03 15:04:54.377718 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.377684 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/563794dc-3226-4b76-83a8-e5992deda67a-service-ca" (OuterVolumeSpecName: "service-ca") pod "563794dc-3226-4b76-83a8-e5992deda67a" (UID: "563794dc-3226-4b76-83a8-e5992deda67a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:04:54.377838 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.377719 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/563794dc-3226-4b76-83a8-e5992deda67a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "563794dc-3226-4b76-83a8-e5992deda67a" (UID: "563794dc-3226-4b76-83a8-e5992deda67a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:04:54.377838 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.377743 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/563794dc-3226-4b76-83a8-e5992deda67a-console-config" (OuterVolumeSpecName: "console-config") pod "563794dc-3226-4b76-83a8-e5992deda67a" (UID: "563794dc-3226-4b76-83a8-e5992deda67a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:04:54.379633 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.379608 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/563794dc-3226-4b76-83a8-e5992deda67a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "563794dc-3226-4b76-83a8-e5992deda67a" (UID: "563794dc-3226-4b76-83a8-e5992deda67a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:04:54.379728 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.379681 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/563794dc-3226-4b76-83a8-e5992deda67a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "563794dc-3226-4b76-83a8-e5992deda67a" (UID: "563794dc-3226-4b76-83a8-e5992deda67a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:04:54.379728 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.379696 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/563794dc-3226-4b76-83a8-e5992deda67a-kube-api-access-7ppk4" (OuterVolumeSpecName: "kube-api-access-7ppk4") pod "563794dc-3226-4b76-83a8-e5992deda67a" (UID: "563794dc-3226-4b76-83a8-e5992deda67a"). InnerVolumeSpecName "kube-api-access-7ppk4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:04:54.478795 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.478755 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/563794dc-3226-4b76-83a8-e5992deda67a-console-oauth-config\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:04:54.478795 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.478786 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ppk4\" (UniqueName: \"kubernetes.io/projected/563794dc-3226-4b76-83a8-e5992deda67a-kube-api-access-7ppk4\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:04:54.478795 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.478800 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/563794dc-3226-4b76-83a8-e5992deda67a-oauth-serving-cert\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:04:54.479032 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.478813 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/563794dc-3226-4b76-83a8-e5992deda67a-console-config\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:04:54.479032 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.478827 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/563794dc-3226-4b76-83a8-e5992deda67a-console-serving-cert\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:04:54.479032 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.478839 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/563794dc-3226-4b76-83a8-e5992deda67a-service-ca\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:04:54.914496 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.914471 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5448fd56c5-qcvlr_563794dc-3226-4b76-83a8-e5992deda67a/console/0.log" Jun 03 15:04:54.914659 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.914510 2577 generic.go:358] "Generic (PLEG): container finished" podID="563794dc-3226-4b76-83a8-e5992deda67a" containerID="286b3c2ea190b323b0ea514779eddb55deba40666580a6a8003384434124ccf1" exitCode=2 Jun 03 15:04:54.914659 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.914578 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5448fd56c5-qcvlr" Jun 03 15:04:54.914659 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.914602 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5448fd56c5-qcvlr" event={"ID":"563794dc-3226-4b76-83a8-e5992deda67a","Type":"ContainerDied","Data":"286b3c2ea190b323b0ea514779eddb55deba40666580a6a8003384434124ccf1"} Jun 03 15:04:54.914659 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.914638 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5448fd56c5-qcvlr" event={"ID":"563794dc-3226-4b76-83a8-e5992deda67a","Type":"ContainerDied","Data":"b7d302eb34b54221c62d923f7ddfde8f9b2d93a43944469adebe6370d097b2b5"} Jun 03 15:04:54.914659 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.914655 2577 scope.go:117] "RemoveContainer" containerID="286b3c2ea190b323b0ea514779eddb55deba40666580a6a8003384434124ccf1" Jun 03 15:04:54.923207 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.923191 2577 scope.go:117] "RemoveContainer" containerID="286b3c2ea190b323b0ea514779eddb55deba40666580a6a8003384434124ccf1" Jun 03 15:04:54.923436 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:04:54.923417 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"286b3c2ea190b323b0ea514779eddb55deba40666580a6a8003384434124ccf1\": container with ID starting with 286b3c2ea190b323b0ea514779eddb55deba40666580a6a8003384434124ccf1 not found: ID does not exist" containerID="286b3c2ea190b323b0ea514779eddb55deba40666580a6a8003384434124ccf1" Jun 03 15:04:54.923502 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.923443 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"286b3c2ea190b323b0ea514779eddb55deba40666580a6a8003384434124ccf1"} err="failed to get container status \"286b3c2ea190b323b0ea514779eddb55deba40666580a6a8003384434124ccf1\": rpc error: code = NotFound desc = could not find container \"286b3c2ea190b323b0ea514779eddb55deba40666580a6a8003384434124ccf1\": container with ID starting with 286b3c2ea190b323b0ea514779eddb55deba40666580a6a8003384434124ccf1 not found: ID does not exist" Jun 03 15:04:54.940378 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.940336 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5448fd56c5-qcvlr"] Jun 03 15:04:54.942306 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:54.942289 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5448fd56c5-qcvlr"] Jun 03 15:04:55.244635 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:04:55.244540 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="563794dc-3226-4b76-83a8-e5992deda67a" path="/var/lib/kubelet/pods/563794dc-3226-4b76-83a8-e5992deda67a/volumes" Jun 03 15:05:00.859331 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:00.859271 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5d8769d8d4-hpk47" podUID="67d27999-9a35-4b68-a20b-8b14efce4e3e" containerName="console" containerID="cri-o://553c9f28b32022597c7223c2a9c1659d6368bba24cdca60bf3f32b15fd625380" gracePeriod=15 Jun 03 15:05:01.104408 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.104387 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d8769d8d4-hpk47_67d27999-9a35-4b68-a20b-8b14efce4e3e/console/0.log" Jun 03 15:05:01.104514 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.104447 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:05:01.244571 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.244498 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-oauth-serving-cert\") pod \"67d27999-9a35-4b68-a20b-8b14efce4e3e\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " Jun 03 15:05:01.244571 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.244537 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcchv\" (UniqueName: \"kubernetes.io/projected/67d27999-9a35-4b68-a20b-8b14efce4e3e-kube-api-access-pcchv\") pod \"67d27999-9a35-4b68-a20b-8b14efce4e3e\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " Jun 03 15:05:01.244571 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.244572 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67d27999-9a35-4b68-a20b-8b14efce4e3e-console-oauth-config\") pod \"67d27999-9a35-4b68-a20b-8b14efce4e3e\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " Jun 03 15:05:01.244828 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.244617 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-trusted-ca-bundle\") pod \"67d27999-9a35-4b68-a20b-8b14efce4e3e\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " Jun 03 15:05:01.244828 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.244650 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67d27999-9a35-4b68-a20b-8b14efce4e3e-console-serving-cert\") pod \"67d27999-9a35-4b68-a20b-8b14efce4e3e\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " Jun 03 15:05:01.244828 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.244672 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-console-config\") pod \"67d27999-9a35-4b68-a20b-8b14efce4e3e\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " Jun 03 15:05:01.244828 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.244690 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-service-ca\") pod \"67d27999-9a35-4b68-a20b-8b14efce4e3e\" (UID: \"67d27999-9a35-4b68-a20b-8b14efce4e3e\") " Jun 03 15:05:01.245085 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.244935 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "67d27999-9a35-4b68-a20b-8b14efce4e3e" (UID: "67d27999-9a35-4b68-a20b-8b14efce4e3e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:05:01.245198 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.245166 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-console-config" (OuterVolumeSpecName: "console-config") pod "67d27999-9a35-4b68-a20b-8b14efce4e3e" (UID: "67d27999-9a35-4b68-a20b-8b14efce4e3e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:05:01.245198 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.245183 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-service-ca" (OuterVolumeSpecName: "service-ca") pod "67d27999-9a35-4b68-a20b-8b14efce4e3e" (UID: "67d27999-9a35-4b68-a20b-8b14efce4e3e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:05:01.245198 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.245178 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "67d27999-9a35-4b68-a20b-8b14efce4e3e" (UID: "67d27999-9a35-4b68-a20b-8b14efce4e3e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:05:01.246789 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.246770 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67d27999-9a35-4b68-a20b-8b14efce4e3e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "67d27999-9a35-4b68-a20b-8b14efce4e3e" (UID: "67d27999-9a35-4b68-a20b-8b14efce4e3e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:01.247191 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.247168 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67d27999-9a35-4b68-a20b-8b14efce4e3e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "67d27999-9a35-4b68-a20b-8b14efce4e3e" (UID: "67d27999-9a35-4b68-a20b-8b14efce4e3e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:01.247191 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.247182 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67d27999-9a35-4b68-a20b-8b14efce4e3e-kube-api-access-pcchv" (OuterVolumeSpecName: "kube-api-access-pcchv") pod "67d27999-9a35-4b68-a20b-8b14efce4e3e" (UID: "67d27999-9a35-4b68-a20b-8b14efce4e3e"). InnerVolumeSpecName "kube-api-access-pcchv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:05:01.346040 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.346007 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-oauth-serving-cert\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:01.346040 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.346034 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcchv\" (UniqueName: \"kubernetes.io/projected/67d27999-9a35-4b68-a20b-8b14efce4e3e-kube-api-access-pcchv\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:01.346040 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.346044 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67d27999-9a35-4b68-a20b-8b14efce4e3e-console-oauth-config\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:01.346269 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.346055 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-trusted-ca-bundle\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:01.346269 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.346064 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67d27999-9a35-4b68-a20b-8b14efce4e3e-console-serving-cert\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:01.346269 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.346074 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-console-config\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:01.346269 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.346084 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67d27999-9a35-4b68-a20b-8b14efce4e3e-service-ca\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:01.938087 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.938060 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d8769d8d4-hpk47_67d27999-9a35-4b68-a20b-8b14efce4e3e/console/0.log" Jun 03 15:05:01.938548 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.938114 2577 generic.go:358] "Generic (PLEG): container finished" podID="67d27999-9a35-4b68-a20b-8b14efce4e3e" containerID="553c9f28b32022597c7223c2a9c1659d6368bba24cdca60bf3f32b15fd625380" exitCode=2 Jun 03 15:05:01.938548 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.938147 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8769d8d4-hpk47" event={"ID":"67d27999-9a35-4b68-a20b-8b14efce4e3e","Type":"ContainerDied","Data":"553c9f28b32022597c7223c2a9c1659d6368bba24cdca60bf3f32b15fd625380"} Jun 03 15:05:01.938548 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.938179 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8769d8d4-hpk47" Jun 03 15:05:01.938548 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.938200 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8769d8d4-hpk47" event={"ID":"67d27999-9a35-4b68-a20b-8b14efce4e3e","Type":"ContainerDied","Data":"1ecb28580942b63e48ddf3871e558a9e395a2092a09b197e634d3e87ea0a58ed"} Jun 03 15:05:01.938548 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.938225 2577 scope.go:117] "RemoveContainer" containerID="553c9f28b32022597c7223c2a9c1659d6368bba24cdca60bf3f32b15fd625380" Jun 03 15:05:01.947900 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.947887 2577 scope.go:117] "RemoveContainer" containerID="553c9f28b32022597c7223c2a9c1659d6368bba24cdca60bf3f32b15fd625380" Jun 03 15:05:01.948128 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:05:01.948112 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"553c9f28b32022597c7223c2a9c1659d6368bba24cdca60bf3f32b15fd625380\": container with ID starting with 553c9f28b32022597c7223c2a9c1659d6368bba24cdca60bf3f32b15fd625380 not found: ID does not exist" containerID="553c9f28b32022597c7223c2a9c1659d6368bba24cdca60bf3f32b15fd625380" Jun 03 15:05:01.948170 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.948134 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"553c9f28b32022597c7223c2a9c1659d6368bba24cdca60bf3f32b15fd625380"} err="failed to get container status \"553c9f28b32022597c7223c2a9c1659d6368bba24cdca60bf3f32b15fd625380\": rpc error: code = NotFound desc = could not find container \"553c9f28b32022597c7223c2a9c1659d6368bba24cdca60bf3f32b15fd625380\": container with ID starting with 553c9f28b32022597c7223c2a9c1659d6368bba24cdca60bf3f32b15fd625380 not found: ID does not exist" Jun 03 15:05:01.960646 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.960620 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d8769d8d4-hpk47"] Jun 03 15:05:01.965010 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:01.964991 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d8769d8d4-hpk47"] Jun 03 15:05:02.957788 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:02.957755 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs\") pod \"network-metrics-daemon-klxj7\" (UID: \"80b3ece5-3176-4984-821a-d8817e635c90\") " pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:05:02.959931 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:02.959911 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80b3ece5-3176-4984-821a-d8817e635c90-metrics-certs\") pod \"network-metrics-daemon-klxj7\" (UID: \"80b3ece5-3176-4984-821a-d8817e635c90\") " pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:05:03.166771 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:03.166741 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6cj8w\"" Jun 03 15:05:03.174999 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:03.174969 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klxj7" Jun 03 15:05:03.244607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:03.244579 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67d27999-9a35-4b68-a20b-8b14efce4e3e" path="/var/lib/kubelet/pods/67d27999-9a35-4b68-a20b-8b14efce4e3e/volumes" Jun 03 15:05:03.307543 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:03.307411 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-klxj7"] Jun 03 15:05:03.310299 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:05:03.310265 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80b3ece5_3176_4984_821a_d8817e635c90.slice/crio-7280a34581d14eddc90c110999af8923fffaffc0fb1da27d9f25518fcc9b0f2d WatchSource:0}: Error finding container 7280a34581d14eddc90c110999af8923fffaffc0fb1da27d9f25518fcc9b0f2d: Status 404 returned error can't find the container with id 7280a34581d14eddc90c110999af8923fffaffc0fb1da27d9f25518fcc9b0f2d Jun 03 15:05:03.947098 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:03.947050 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-klxj7" event={"ID":"80b3ece5-3176-4984-821a-d8817e635c90","Type":"ContainerStarted","Data":"7280a34581d14eddc90c110999af8923fffaffc0fb1da27d9f25518fcc9b0f2d"} Jun 03 15:05:04.952492 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:04.952460 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-klxj7" event={"ID":"80b3ece5-3176-4984-821a-d8817e635c90","Type":"ContainerStarted","Data":"6dd170af55b0465ec7a965f885c6fdbce8bf05ef3834609a3d1bcfdb02805e83"} Jun 03 15:05:05.918287 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:05.918238 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-774f88d448-wpp89" podUID="866c3310-011a-4ab6-b677-93e8eeabd1d6" containerName="registry" containerID="cri-o://4c897e355ce625f6a1dc90f5c2b961bf2fa3c622816f16d45850d3d2316900b1" gracePeriod=30 Jun 03 15:05:05.956553 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:05.956521 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-klxj7" event={"ID":"80b3ece5-3176-4984-821a-d8817e635c90","Type":"ContainerStarted","Data":"bb4c42aec8e761122fbe06ca46231b33dc9f2e04d3ea633e7cc086183acebd58"} Jun 03 15:05:05.977120 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:05.977065 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-klxj7" podStartSLOduration=131.469328999 podStartE2EDuration="2m12.977050134s" podCreationTimestamp="2026-06-03 15:02:53 +0000 UTC" firstStartedPulling="2026-06-03 15:05:03.311991736 +0000 UTC m=+130.664961739" lastFinishedPulling="2026-06-03 15:05:04.819712854 +0000 UTC m=+132.172682874" observedRunningTime="2026-06-03 15:05:05.975539639 +0000 UTC m=+133.328509678" watchObservedRunningTime="2026-06-03 15:05:05.977050134 +0000 UTC m=+133.330020154" Jun 03 15:05:06.187470 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.187448 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:05:06.287678 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.287648 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-bound-sa-token\") pod \"866c3310-011a-4ab6-b677-93e8eeabd1d6\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " Jun 03 15:05:06.287865 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.287698 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/866c3310-011a-4ab6-b677-93e8eeabd1d6-image-registry-private-configuration\") pod \"866c3310-011a-4ab6-b677-93e8eeabd1d6\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " Jun 03 15:05:06.287865 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.287715 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/866c3310-011a-4ab6-b677-93e8eeabd1d6-installation-pull-secrets\") pod \"866c3310-011a-4ab6-b677-93e8eeabd1d6\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " Jun 03 15:05:06.287865 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.287736 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-certificates\") pod \"866c3310-011a-4ab6-b677-93e8eeabd1d6\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " Jun 03 15:05:06.287865 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.287758 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkmdw\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-kube-api-access-bkmdw\") pod \"866c3310-011a-4ab6-b677-93e8eeabd1d6\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " Jun 03 15:05:06.287865 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.287787 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/866c3310-011a-4ab6-b677-93e8eeabd1d6-ca-trust-extracted\") pod \"866c3310-011a-4ab6-b677-93e8eeabd1d6\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " Jun 03 15:05:06.287865 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.287807 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/866c3310-011a-4ab6-b677-93e8eeabd1d6-trusted-ca\") pod \"866c3310-011a-4ab6-b677-93e8eeabd1d6\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " Jun 03 15:05:06.287865 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.287828 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls\") pod \"866c3310-011a-4ab6-b677-93e8eeabd1d6\" (UID: \"866c3310-011a-4ab6-b677-93e8eeabd1d6\") " Jun 03 15:05:06.288245 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.288220 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "866c3310-011a-4ab6-b677-93e8eeabd1d6" (UID: "866c3310-011a-4ab6-b677-93e8eeabd1d6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:05:06.288315 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.288287 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/866c3310-011a-4ab6-b677-93e8eeabd1d6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "866c3310-011a-4ab6-b677-93e8eeabd1d6" (UID: "866c3310-011a-4ab6-b677-93e8eeabd1d6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:05:06.290349 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.290306 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "866c3310-011a-4ab6-b677-93e8eeabd1d6" (UID: "866c3310-011a-4ab6-b677-93e8eeabd1d6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:05:06.290494 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.290458 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/866c3310-011a-4ab6-b677-93e8eeabd1d6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "866c3310-011a-4ab6-b677-93e8eeabd1d6" (UID: "866c3310-011a-4ab6-b677-93e8eeabd1d6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:06.290596 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.290574 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/866c3310-011a-4ab6-b677-93e8eeabd1d6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "866c3310-011a-4ab6-b677-93e8eeabd1d6" (UID: "866c3310-011a-4ab6-b677-93e8eeabd1d6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:06.290730 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.290702 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "866c3310-011a-4ab6-b677-93e8eeabd1d6" (UID: "866c3310-011a-4ab6-b677-93e8eeabd1d6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:05:06.290779 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.290708 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-kube-api-access-bkmdw" (OuterVolumeSpecName: "kube-api-access-bkmdw") pod "866c3310-011a-4ab6-b677-93e8eeabd1d6" (UID: "866c3310-011a-4ab6-b677-93e8eeabd1d6"). InnerVolumeSpecName "kube-api-access-bkmdw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:05:06.296064 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.296037 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/866c3310-011a-4ab6-b677-93e8eeabd1d6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "866c3310-011a-4ab6-b677-93e8eeabd1d6" (UID: "866c3310-011a-4ab6-b677-93e8eeabd1d6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:05:06.388834 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.388791 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/866c3310-011a-4ab6-b677-93e8eeabd1d6-image-registry-private-configuration\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:06.388834 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.388831 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/866c3310-011a-4ab6-b677-93e8eeabd1d6-installation-pull-secrets\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:06.389075 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.388846 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-certificates\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:06.389075 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.388861 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkmdw\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-kube-api-access-bkmdw\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:06.389075 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.388876 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/866c3310-011a-4ab6-b677-93e8eeabd1d6-ca-trust-extracted\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:06.389075 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.388890 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/866c3310-011a-4ab6-b677-93e8eeabd1d6-trusted-ca\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:06.389075 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.388905 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-registry-tls\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:06.389075 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.388918 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/866c3310-011a-4ab6-b677-93e8eeabd1d6-bound-sa-token\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:06.961576 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.961539 2577 generic.go:358] "Generic (PLEG): container finished" podID="866c3310-011a-4ab6-b677-93e8eeabd1d6" containerID="4c897e355ce625f6a1dc90f5c2b961bf2fa3c622816f16d45850d3d2316900b1" exitCode=0 Jun 03 15:05:06.962075 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.961609 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774f88d448-wpp89" Jun 03 15:05:06.962075 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.961630 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-774f88d448-wpp89" event={"ID":"866c3310-011a-4ab6-b677-93e8eeabd1d6","Type":"ContainerDied","Data":"4c897e355ce625f6a1dc90f5c2b961bf2fa3c622816f16d45850d3d2316900b1"} Jun 03 15:05:06.962075 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.961669 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-774f88d448-wpp89" event={"ID":"866c3310-011a-4ab6-b677-93e8eeabd1d6","Type":"ContainerDied","Data":"aeb578768e228e8c29497201d576dbf7ab27860d4f04e557c491ef9d8e40c082"} Jun 03 15:05:06.962075 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.961684 2577 scope.go:117] "RemoveContainer" containerID="4c897e355ce625f6a1dc90f5c2b961bf2fa3c622816f16d45850d3d2316900b1" Jun 03 15:05:06.972470 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.972447 2577 scope.go:117] "RemoveContainer" containerID="4c897e355ce625f6a1dc90f5c2b961bf2fa3c622816f16d45850d3d2316900b1" Jun 03 15:05:06.972719 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:05:06.972700 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c897e355ce625f6a1dc90f5c2b961bf2fa3c622816f16d45850d3d2316900b1\": container with ID starting with 4c897e355ce625f6a1dc90f5c2b961bf2fa3c622816f16d45850d3d2316900b1 not found: ID does not exist" containerID="4c897e355ce625f6a1dc90f5c2b961bf2fa3c622816f16d45850d3d2316900b1" Jun 03 15:05:06.972767 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.972729 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c897e355ce625f6a1dc90f5c2b961bf2fa3c622816f16d45850d3d2316900b1"} err="failed to get container status \"4c897e355ce625f6a1dc90f5c2b961bf2fa3c622816f16d45850d3d2316900b1\": rpc error: code = NotFound desc = could not find container \"4c897e355ce625f6a1dc90f5c2b961bf2fa3c622816f16d45850d3d2316900b1\": container with ID starting with 4c897e355ce625f6a1dc90f5c2b961bf2fa3c622816f16d45850d3d2316900b1 not found: ID does not exist" Jun 03 15:05:06.990221 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.990198 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-774f88d448-wpp89"] Jun 03 15:05:06.993605 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:06.993576 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-774f88d448-wpp89"] Jun 03 15:05:07.243884 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:07.243812 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="866c3310-011a-4ab6-b677-93e8eeabd1d6" path="/var/lib/kubelet/pods/866c3310-011a-4ab6-b677-93e8eeabd1d6/volumes" Jun 03 15:05:09.968161 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:09.968091 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7b787ccb4b-pzbmg" podUID="8f934a9b-8542-412e-84b3-bb23a646d85b" containerName="console" containerID="cri-o://438d2ae296c33de3cfd5d1e0937f680bb50090f36566a5af4727d62432f454c6" gracePeriod=15 Jun 03 15:05:10.226316 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.226266 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b787ccb4b-pzbmg_8f934a9b-8542-412e-84b3-bb23a646d85b/console/0.log" Jun 03 15:05:10.226430 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.226324 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:05:10.324723 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.324681 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6ssw\" (UniqueName: \"kubernetes.io/projected/8f934a9b-8542-412e-84b3-bb23a646d85b-kube-api-access-f6ssw\") pod \"8f934a9b-8542-412e-84b3-bb23a646d85b\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " Jun 03 15:05:10.324905 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.324751 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-console-config\") pod \"8f934a9b-8542-412e-84b3-bb23a646d85b\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " Jun 03 15:05:10.324905 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.324777 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-oauth-serving-cert\") pod \"8f934a9b-8542-412e-84b3-bb23a646d85b\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " Jun 03 15:05:10.324905 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.324795 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f934a9b-8542-412e-84b3-bb23a646d85b-console-oauth-config\") pod \"8f934a9b-8542-412e-84b3-bb23a646d85b\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " Jun 03 15:05:10.324905 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.324846 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-trusted-ca-bundle\") pod \"8f934a9b-8542-412e-84b3-bb23a646d85b\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " Jun 03 15:05:10.324905 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.324878 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-service-ca\") pod \"8f934a9b-8542-412e-84b3-bb23a646d85b\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " Jun 03 15:05:10.325180 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.324908 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f934a9b-8542-412e-84b3-bb23a646d85b-console-serving-cert\") pod \"8f934a9b-8542-412e-84b3-bb23a646d85b\" (UID: \"8f934a9b-8542-412e-84b3-bb23a646d85b\") " Jun 03 15:05:10.325240 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.325207 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-console-config" (OuterVolumeSpecName: "console-config") pod "8f934a9b-8542-412e-84b3-bb23a646d85b" (UID: "8f934a9b-8542-412e-84b3-bb23a646d85b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:05:10.325291 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.325236 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8f934a9b-8542-412e-84b3-bb23a646d85b" (UID: "8f934a9b-8542-412e-84b3-bb23a646d85b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:05:10.325291 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.325272 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8f934a9b-8542-412e-84b3-bb23a646d85b" (UID: "8f934a9b-8542-412e-84b3-bb23a646d85b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:05:10.325657 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.325626 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-service-ca" (OuterVolumeSpecName: "service-ca") pod "8f934a9b-8542-412e-84b3-bb23a646d85b" (UID: "8f934a9b-8542-412e-84b3-bb23a646d85b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:05:10.326899 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.326871 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f934a9b-8542-412e-84b3-bb23a646d85b-kube-api-access-f6ssw" (OuterVolumeSpecName: "kube-api-access-f6ssw") pod "8f934a9b-8542-412e-84b3-bb23a646d85b" (UID: "8f934a9b-8542-412e-84b3-bb23a646d85b"). InnerVolumeSpecName "kube-api-access-f6ssw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:05:10.327048 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.327032 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f934a9b-8542-412e-84b3-bb23a646d85b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8f934a9b-8542-412e-84b3-bb23a646d85b" (UID: "8f934a9b-8542-412e-84b3-bb23a646d85b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:10.327092 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.327050 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f934a9b-8542-412e-84b3-bb23a646d85b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8f934a9b-8542-412e-84b3-bb23a646d85b" (UID: "8f934a9b-8542-412e-84b3-bb23a646d85b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:10.425985 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.425952 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-trusted-ca-bundle\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:10.425985 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.425979 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-service-ca\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:10.426153 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.425994 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8f934a9b-8542-412e-84b3-bb23a646d85b-console-serving-cert\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:10.426153 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.426008 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6ssw\" (UniqueName: \"kubernetes.io/projected/8f934a9b-8542-412e-84b3-bb23a646d85b-kube-api-access-f6ssw\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:10.426153 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.426021 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-console-config\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:10.426153 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.426032 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8f934a9b-8542-412e-84b3-bb23a646d85b-oauth-serving-cert\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:10.426153 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.426044 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8f934a9b-8542-412e-84b3-bb23a646d85b-console-oauth-config\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:05:10.977648 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.977622 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b787ccb4b-pzbmg_8f934a9b-8542-412e-84b3-bb23a646d85b/console/0.log" Jun 03 15:05:10.978037 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.977664 2577 generic.go:358] "Generic (PLEG): container finished" podID="8f934a9b-8542-412e-84b3-bb23a646d85b" containerID="438d2ae296c33de3cfd5d1e0937f680bb50090f36566a5af4727d62432f454c6" exitCode=2 Jun 03 15:05:10.978037 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.977731 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b787ccb4b-pzbmg" Jun 03 15:05:10.978037 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.977751 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b787ccb4b-pzbmg" event={"ID":"8f934a9b-8542-412e-84b3-bb23a646d85b","Type":"ContainerDied","Data":"438d2ae296c33de3cfd5d1e0937f680bb50090f36566a5af4727d62432f454c6"} Jun 03 15:05:10.978037 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.977791 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b787ccb4b-pzbmg" event={"ID":"8f934a9b-8542-412e-84b3-bb23a646d85b","Type":"ContainerDied","Data":"0b17566cfcd59a9f9fb1806721fd27d938c1343e85634187eb485e796ebd5c5a"} Jun 03 15:05:10.978037 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.977809 2577 scope.go:117] "RemoveContainer" containerID="438d2ae296c33de3cfd5d1e0937f680bb50090f36566a5af4727d62432f454c6" Jun 03 15:05:10.986864 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.986849 2577 scope.go:117] "RemoveContainer" containerID="438d2ae296c33de3cfd5d1e0937f680bb50090f36566a5af4727d62432f454c6" Jun 03 15:05:10.987110 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:05:10.987087 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"438d2ae296c33de3cfd5d1e0937f680bb50090f36566a5af4727d62432f454c6\": container with ID starting with 438d2ae296c33de3cfd5d1e0937f680bb50090f36566a5af4727d62432f454c6 not found: ID does not exist" containerID="438d2ae296c33de3cfd5d1e0937f680bb50090f36566a5af4727d62432f454c6" Jun 03 15:05:10.987198 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.987113 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"438d2ae296c33de3cfd5d1e0937f680bb50090f36566a5af4727d62432f454c6"} err="failed to get container status \"438d2ae296c33de3cfd5d1e0937f680bb50090f36566a5af4727d62432f454c6\": rpc error: code = NotFound desc = could not find container \"438d2ae296c33de3cfd5d1e0937f680bb50090f36566a5af4727d62432f454c6\": container with ID starting with 438d2ae296c33de3cfd5d1e0937f680bb50090f36566a5af4727d62432f454c6 not found: ID does not exist" Jun 03 15:05:10.999791 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:10.999768 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b787ccb4b-pzbmg"] Jun 03 15:05:11.003160 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:11.003140 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b787ccb4b-pzbmg"] Jun 03 15:05:11.243618 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:11.243542 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f934a9b-8542-412e-84b3-bb23a646d85b" path="/var/lib/kubelet/pods/8f934a9b-8542-412e-84b3-bb23a646d85b/volumes" Jun 03 15:05:14.991586 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:14.991555 2577 generic.go:358] "Generic (PLEG): container finished" podID="6c1d6767-775a-4feb-ab75-d42366001da8" containerID="d78d4b5feb11cd4c969bb4eec24ac212b590a2fc8e3293f5796903138a82140f" exitCode=0 Jun 03 15:05:14.991881 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:14.991599 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss" event={"ID":"6c1d6767-775a-4feb-ab75-d42366001da8","Type":"ContainerDied","Data":"d78d4b5feb11cd4c969bb4eec24ac212b590a2fc8e3293f5796903138a82140f"} Jun 03 15:05:14.991930 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:14.991910 2577 scope.go:117] "RemoveContainer" containerID="d78d4b5feb11cd4c969bb4eec24ac212b590a2fc8e3293f5796903138a82140f" Jun 03 15:05:15.996406 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:15.996359 2577 generic.go:358] "Generic (PLEG): container finished" podID="04be6e74-740f-48d9-a3f6-32f7466b9520" containerID="ac27aca1270aa3bd91137e6d96a82b04cf4a753e0dce38fe98ba950b6f987d0c" exitCode=0 Jun 03 15:05:15.996877 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:15.996434 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-59r7c" event={"ID":"04be6e74-740f-48d9-a3f6-32f7466b9520","Type":"ContainerDied","Data":"ac27aca1270aa3bd91137e6d96a82b04cf4a753e0dce38fe98ba950b6f987d0c"} Jun 03 15:05:15.996877 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:15.996805 2577 scope.go:117] "RemoveContainer" containerID="ac27aca1270aa3bd91137e6d96a82b04cf4a753e0dce38fe98ba950b6f987d0c" Jun 03 15:05:15.997877 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:15.997856 2577 generic.go:358] "Generic (PLEG): container finished" podID="1536eb21-7935-4dc8-8066-9e6d7e6c3ab5" containerID="68e8b81330267b7f0acc979bb769323dc3b5efac0c1a20ffb4b4805f3346efd9" exitCode=0 Jun 03 15:05:15.997981 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:15.997943 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-lkk8x" event={"ID":"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5","Type":"ContainerDied","Data":"68e8b81330267b7f0acc979bb769323dc3b5efac0c1a20ffb4b4805f3346efd9"} Jun 03 15:05:15.998245 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:15.998230 2577 scope.go:117] "RemoveContainer" containerID="68e8b81330267b7f0acc979bb769323dc3b5efac0c1a20ffb4b4805f3346efd9" Jun 03 15:05:15.999616 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:15.999596 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-vzpss" event={"ID":"6c1d6767-775a-4feb-ab75-d42366001da8","Type":"ContainerStarted","Data":"ac43a5438afed4531696fc726a4cb9659bfab4007e1e0ae13488ce8b373547dd"} Jun 03 15:05:17.004605 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:17.004573 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-59r7c" event={"ID":"04be6e74-740f-48d9-a3f6-32f7466b9520","Type":"ContainerStarted","Data":"4253aa5975c7245daade92cae9d077ec07cef02a1362ab9267ec1a9736b27ccc"} Jun 03 15:05:17.006132 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:17.006109 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-lkk8x" event={"ID":"1536eb21-7935-4dc8-8066-9e6d7e6c3ab5","Type":"ContainerStarted","Data":"b1750d3787bf06387ecc01a533331573a12fa9c5d7a9b7b1ed3a938f1d77092e"} Jun 03 15:05:18.444773 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:18.444737 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" podUID="acc4bf03-9c54-471c-a6eb-2dec415170d6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 15:05:28.444740 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:28.444696 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" podUID="acc4bf03-9c54-471c-a6eb-2dec415170d6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 15:05:38.444449 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:38.444402 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" podUID="acc4bf03-9c54-471c-a6eb-2dec415170d6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 15:05:38.444923 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:38.444491 2577 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" Jun 03 15:05:38.445090 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:38.445068 2577 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"0b77f544d0f0b3500fbdf207d9729c29ad5bc385e4fbbd531a32dc96fe54ac19"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 03 15:05:38.445166 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:38.445117 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" podUID="acc4bf03-9c54-471c-a6eb-2dec415170d6" containerName="service-proxy" containerID="cri-o://0b77f544d0f0b3500fbdf207d9729c29ad5bc385e4fbbd531a32dc96fe54ac19" gracePeriod=30 Jun 03 15:05:39.087847 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:39.087810 2577 generic.go:358] "Generic (PLEG): container finished" podID="acc4bf03-9c54-471c-a6eb-2dec415170d6" containerID="0b77f544d0f0b3500fbdf207d9729c29ad5bc385e4fbbd531a32dc96fe54ac19" exitCode=2 Jun 03 15:05:39.088022 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:39.087870 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" event={"ID":"acc4bf03-9c54-471c-a6eb-2dec415170d6","Type":"ContainerDied","Data":"0b77f544d0f0b3500fbdf207d9729c29ad5bc385e4fbbd531a32dc96fe54ac19"} Jun 03 15:05:39.088022 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:39.087900 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5d7dcc84-58rn4" event={"ID":"acc4bf03-9c54-471c-a6eb-2dec415170d6","Type":"ContainerStarted","Data":"bf99b78b1e22413526f4e8fc4bbc48bc0185d7f20502b43ab5d130e9debf9050"} Jun 03 15:05:48.978312 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:48.978277 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-8576785654-zfb85"] Jun 03 15:05:48.979034 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:48.979004 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67d27999-9a35-4b68-a20b-8b14efce4e3e" containerName="console" Jun 03 15:05:48.979034 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:48.979033 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="67d27999-9a35-4b68-a20b-8b14efce4e3e" containerName="console" Jun 03 15:05:48.979034 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:48.979042 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="866c3310-011a-4ab6-b677-93e8eeabd1d6" containerName="registry" Jun 03 15:05:48.979034 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:48.979048 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="866c3310-011a-4ab6-b677-93e8eeabd1d6" containerName="registry" Jun 03 15:05:48.979287 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:48.979061 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="563794dc-3226-4b76-83a8-e5992deda67a" containerName="console" Jun 03 15:05:48.979287 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:48.979070 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="563794dc-3226-4b76-83a8-e5992deda67a" containerName="console" Jun 03 15:05:48.979287 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:48.979099 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f934a9b-8542-412e-84b3-bb23a646d85b" containerName="console" Jun 03 15:05:48.979287 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:48.979108 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f934a9b-8542-412e-84b3-bb23a646d85b" containerName="console" Jun 03 15:05:48.979287 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:48.979117 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5cc1a7b-de22-4984-94d2-a6c717d2acf3" containerName="registry" Jun 03 15:05:48.979287 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:48.979125 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5cc1a7b-de22-4984-94d2-a6c717d2acf3" containerName="registry" Jun 03 15:05:48.979287 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:48.979220 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="67d27999-9a35-4b68-a20b-8b14efce4e3e" containerName="console" Jun 03 15:05:48.979287 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:48.979232 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5cc1a7b-de22-4984-94d2-a6c717d2acf3" containerName="registry" Jun 03 15:05:48.979287 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:48.979244 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="563794dc-3226-4b76-83a8-e5992deda67a" containerName="console" Jun 03 15:05:48.979287 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:48.979258 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f934a9b-8542-412e-84b3-bb23a646d85b" containerName="console" Jun 03 15:05:48.979287 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:48.979267 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="866c3310-011a-4ab6-b677-93e8eeabd1d6" containerName="registry" Jun 03 15:05:48.982046 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:48.982019 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:48.992063 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:48.992031 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8576785654-zfb85"] Jun 03 15:05:49.138847 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.138817 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e40aff1f-c0bf-4c39-8e11-4d761c748c37-console-serving-cert\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.139085 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.138851 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-console-config\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.139085 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.138872 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-service-ca\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.139085 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.138906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-trusted-ca-bundle\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.139085 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.138941 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87rrv\" (UniqueName: \"kubernetes.io/projected/e40aff1f-c0bf-4c39-8e11-4d761c748c37-kube-api-access-87rrv\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.139085 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.138964 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e40aff1f-c0bf-4c39-8e11-4d761c748c37-console-oauth-config\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.139085 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.138992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-oauth-serving-cert\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.240050 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.239952 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e40aff1f-c0bf-4c39-8e11-4d761c748c37-console-serving-cert\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.240050 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.239999 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-console-config\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.240050 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.240021 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-service-ca\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.240324 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.240072 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-trusted-ca-bundle\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.240324 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.240102 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87rrv\" (UniqueName: \"kubernetes.io/projected/e40aff1f-c0bf-4c39-8e11-4d761c748c37-kube-api-access-87rrv\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.240324 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.240135 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e40aff1f-c0bf-4c39-8e11-4d761c748c37-console-oauth-config\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.240324 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.240164 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-oauth-serving-cert\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.240786 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.240754 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-console-config\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.240897 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.240841 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-service-ca\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.241085 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.241043 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-oauth-serving-cert\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.241233 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.241171 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-trusted-ca-bundle\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.242741 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.242718 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e40aff1f-c0bf-4c39-8e11-4d761c748c37-console-oauth-config\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.242966 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.242949 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e40aff1f-c0bf-4c39-8e11-4d761c748c37-console-serving-cert\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.248694 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.248677 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87rrv\" (UniqueName: \"kubernetes.io/projected/e40aff1f-c0bf-4c39-8e11-4d761c748c37-kube-api-access-87rrv\") pod \"console-8576785654-zfb85\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.296987 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.296935 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:49.430097 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:05:49.430068 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode40aff1f_c0bf_4c39_8e11_4d761c748c37.slice/crio-011f80ae5ff4b7b81cb01edb2675ff228dabf692a8b4a373ddc18ac8ce93d2bd WatchSource:0}: Error finding container 011f80ae5ff4b7b81cb01edb2675ff228dabf692a8b4a373ddc18ac8ce93d2bd: Status 404 returned error can't find the container with id 011f80ae5ff4b7b81cb01edb2675ff228dabf692a8b4a373ddc18ac8ce93d2bd Jun 03 15:05:49.440756 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:49.440732 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8576785654-zfb85"] Jun 03 15:05:50.133405 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:50.133350 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8576785654-zfb85" event={"ID":"e40aff1f-c0bf-4c39-8e11-4d761c748c37","Type":"ContainerStarted","Data":"c4b411362a59978a063e498b28f37237b4a61e94880690f0da1548feb1916dee"} Jun 03 15:05:50.133405 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:50.133410 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8576785654-zfb85" event={"ID":"e40aff1f-c0bf-4c39-8e11-4d761c748c37","Type":"ContainerStarted","Data":"011f80ae5ff4b7b81cb01edb2675ff228dabf692a8b4a373ddc18ac8ce93d2bd"} Jun 03 15:05:50.154688 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:50.154639 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-8576785654-zfb85" podStartSLOduration=2.154624561 podStartE2EDuration="2.154624561s" podCreationTimestamp="2026-06-03 15:05:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:05:50.154143279 +0000 UTC m=+177.507113326" watchObservedRunningTime="2026-06-03 15:05:50.154624561 +0000 UTC m=+177.507594587" Jun 03 15:05:59.297998 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:59.297952 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:59.297998 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:59.298005 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8576785654-zfb85" Jun 03 15:05:59.302782 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:05:59.302759 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8576785654-zfb85" Jun 03 15:06:00.168227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:00.168197 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8576785654-zfb85" Jun 03 15:06:00.227277 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:00.227246 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d497cb9dc-ps8rk"] Jun 03 15:06:25.249783 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.249743 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6d497cb9dc-ps8rk" podUID="6af43e4d-9145-4786-b79f-fb57ce780841" containerName="console" containerID="cri-o://f55bea3ddace8373506ae7229d52ab8904c6a01304f11cf594100cf94113b902" gracePeriod=15 Jun 03 15:06:25.507061 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.507009 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d497cb9dc-ps8rk_6af43e4d-9145-4786-b79f-fb57ce780841/console/0.log" Jun 03 15:06:25.507161 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.507069 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:06:25.545322 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.545292 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-oauth-serving-cert\") pod \"6af43e4d-9145-4786-b79f-fb57ce780841\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " Jun 03 15:06:25.545511 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.545356 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6af43e4d-9145-4786-b79f-fb57ce780841-console-serving-cert\") pod \"6af43e4d-9145-4786-b79f-fb57ce780841\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " Jun 03 15:06:25.545511 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.545406 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-service-ca\") pod \"6af43e4d-9145-4786-b79f-fb57ce780841\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " Jun 03 15:06:25.545511 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.545470 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-trusted-ca-bundle\") pod \"6af43e4d-9145-4786-b79f-fb57ce780841\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " Jun 03 15:06:25.545672 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.545569 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6c78\" (UniqueName: \"kubernetes.io/projected/6af43e4d-9145-4786-b79f-fb57ce780841-kube-api-access-w6c78\") pod \"6af43e4d-9145-4786-b79f-fb57ce780841\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " Jun 03 15:06:25.545672 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.545618 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6af43e4d-9145-4786-b79f-fb57ce780841-console-oauth-config\") pod \"6af43e4d-9145-4786-b79f-fb57ce780841\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " Jun 03 15:06:25.545781 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.545678 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-console-config\") pod \"6af43e4d-9145-4786-b79f-fb57ce780841\" (UID: \"6af43e4d-9145-4786-b79f-fb57ce780841\") " Jun 03 15:06:25.545874 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.545854 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6af43e4d-9145-4786-b79f-fb57ce780841" (UID: "6af43e4d-9145-4786-b79f-fb57ce780841"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:06:25.545942 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.545864 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-service-ca" (OuterVolumeSpecName: "service-ca") pod "6af43e4d-9145-4786-b79f-fb57ce780841" (UID: "6af43e4d-9145-4786-b79f-fb57ce780841"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:06:25.545942 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.545869 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6af43e4d-9145-4786-b79f-fb57ce780841" (UID: "6af43e4d-9145-4786-b79f-fb57ce780841"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:06:25.546046 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.545999 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-oauth-serving-cert\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:06:25.546046 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.546018 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-service-ca\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:06:25.546046 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.546032 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-trusted-ca-bundle\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:06:25.546318 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.546293 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-console-config" (OuterVolumeSpecName: "console-config") pod "6af43e4d-9145-4786-b79f-fb57ce780841" (UID: "6af43e4d-9145-4786-b79f-fb57ce780841"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:06:25.547846 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.547823 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6af43e4d-9145-4786-b79f-fb57ce780841-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6af43e4d-9145-4786-b79f-fb57ce780841" (UID: "6af43e4d-9145-4786-b79f-fb57ce780841"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:06:25.548046 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.548022 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6af43e4d-9145-4786-b79f-fb57ce780841-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6af43e4d-9145-4786-b79f-fb57ce780841" (UID: "6af43e4d-9145-4786-b79f-fb57ce780841"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:06:25.548046 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.548027 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6af43e4d-9145-4786-b79f-fb57ce780841-kube-api-access-w6c78" (OuterVolumeSpecName: "kube-api-access-w6c78") pod "6af43e4d-9145-4786-b79f-fb57ce780841" (UID: "6af43e4d-9145-4786-b79f-fb57ce780841"). InnerVolumeSpecName "kube-api-access-w6c78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:06:25.647070 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.647034 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6af43e4d-9145-4786-b79f-fb57ce780841-console-serving-cert\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:06:25.647070 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.647060 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6c78\" (UniqueName: \"kubernetes.io/projected/6af43e4d-9145-4786-b79f-fb57ce780841-kube-api-access-w6c78\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:06:25.647070 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.647073 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6af43e4d-9145-4786-b79f-fb57ce780841-console-oauth-config\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:06:25.647287 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:25.647082 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6af43e4d-9145-4786-b79f-fb57ce780841-console-config\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:06:26.250605 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:26.250581 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d497cb9dc-ps8rk_6af43e4d-9145-4786-b79f-fb57ce780841/console/0.log" Jun 03 15:06:26.251043 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:26.250622 2577 generic.go:358] "Generic (PLEG): container finished" podID="6af43e4d-9145-4786-b79f-fb57ce780841" containerID="f55bea3ddace8373506ae7229d52ab8904c6a01304f11cf594100cf94113b902" exitCode=2 Jun 03 15:06:26.251043 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:26.250681 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d497cb9dc-ps8rk" Jun 03 15:06:26.251043 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:26.250713 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d497cb9dc-ps8rk" event={"ID":"6af43e4d-9145-4786-b79f-fb57ce780841","Type":"ContainerDied","Data":"f55bea3ddace8373506ae7229d52ab8904c6a01304f11cf594100cf94113b902"} Jun 03 15:06:26.251043 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:26.250761 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d497cb9dc-ps8rk" event={"ID":"6af43e4d-9145-4786-b79f-fb57ce780841","Type":"ContainerDied","Data":"9644482f5a4f86b776358dce1fe685c252ea4e21bb966eafdeb37ee13b71f4ea"} Jun 03 15:06:26.251043 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:26.250787 2577 scope.go:117] "RemoveContainer" containerID="f55bea3ddace8373506ae7229d52ab8904c6a01304f11cf594100cf94113b902" Jun 03 15:06:26.259846 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:26.259828 2577 scope.go:117] "RemoveContainer" containerID="f55bea3ddace8373506ae7229d52ab8904c6a01304f11cf594100cf94113b902" Jun 03 15:06:26.260103 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:06:26.260084 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f55bea3ddace8373506ae7229d52ab8904c6a01304f11cf594100cf94113b902\": container with ID starting with f55bea3ddace8373506ae7229d52ab8904c6a01304f11cf594100cf94113b902 not found: ID does not exist" containerID="f55bea3ddace8373506ae7229d52ab8904c6a01304f11cf594100cf94113b902" Jun 03 15:06:26.260148 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:26.260111 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f55bea3ddace8373506ae7229d52ab8904c6a01304f11cf594100cf94113b902"} err="failed to get container status \"f55bea3ddace8373506ae7229d52ab8904c6a01304f11cf594100cf94113b902\": rpc error: code = NotFound desc = could not find container \"f55bea3ddace8373506ae7229d52ab8904c6a01304f11cf594100cf94113b902\": container with ID starting with f55bea3ddace8373506ae7229d52ab8904c6a01304f11cf594100cf94113b902 not found: ID does not exist" Jun 03 15:06:26.276948 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:26.276927 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d497cb9dc-ps8rk"] Jun 03 15:06:26.279441 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:26.279421 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d497cb9dc-ps8rk"] Jun 03 15:06:27.244017 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:06:27.243982 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6af43e4d-9145-4786-b79f-fb57ce780841" path="/var/lib/kubelet/pods/6af43e4d-9145-4786-b79f-fb57ce780841/volumes" Jun 03 15:07:53.117607 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:53.117578 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hskk5_05144d0b-dd83-4d3c-9b43-4480b3fc8a35/console-operator/1.log" Jun 03 15:07:53.121990 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:53.121963 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hskk5_05144d0b-dd83-4d3c-9b43-4480b3fc8a35/console-operator/1.log" Jun 03 15:07:53.126843 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:53.126820 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfwpp_fbb6dd98-36d0-499e-99f8-422e02a621b3/ovn-acl-logging/0.log" Jun 03 15:07:53.129931 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:53.129916 2577 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 15:07:53.130486 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:53.130473 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfwpp_fbb6dd98-36d0-499e-99f8-422e02a621b3/ovn-acl-logging/0.log" Jun 03 15:07:59.744352 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:59.744321 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt"] Jun 03 15:07:59.745775 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:59.744789 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af43e4d-9145-4786-b79f-fb57ce780841" containerName="console" Jun 03 15:07:59.745775 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:59.744805 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af43e4d-9145-4786-b79f-fb57ce780841" containerName="console" Jun 03 15:07:59.745775 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:59.744863 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="6af43e4d-9145-4786-b79f-fb57ce780841" containerName="console" Jun 03 15:07:59.746832 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:59.746813 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:07:59.754050 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:59.754029 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 15:07:59.754157 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:59.754073 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 15:07:59.754157 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:59.754137 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 15:07:59.754157 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:59.754084 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lq6j4\"" Jun 03 15:07:59.755767 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:59.755752 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 15:07:59.770829 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:59.770803 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt"] Jun 03 15:07:59.911389 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:59.911325 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b013a5a0-f6b8-4489-8553-505b3875e1db-webhook-cert\") pod \"opendatahub-operator-controller-manager-5678f4b79b-xmbqt\" (UID: \"b013a5a0-f6b8-4489-8553-505b3875e1db\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:07:59.911584 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:59.911408 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b013a5a0-f6b8-4489-8553-505b3875e1db-manifests\") pod \"opendatahub-operator-controller-manager-5678f4b79b-xmbqt\" (UID: \"b013a5a0-f6b8-4489-8553-505b3875e1db\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:07:59.911584 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:59.911443 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b013a5a0-f6b8-4489-8553-505b3875e1db-tmp\") pod \"opendatahub-operator-controller-manager-5678f4b79b-xmbqt\" (UID: \"b013a5a0-f6b8-4489-8553-505b3875e1db\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:07:59.911584 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:59.911470 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b013a5a0-f6b8-4489-8553-505b3875e1db-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5678f4b79b-xmbqt\" (UID: \"b013a5a0-f6b8-4489-8553-505b3875e1db\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:07:59.911584 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:07:59.911521 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n22r\" (UniqueName: \"kubernetes.io/projected/b013a5a0-f6b8-4489-8553-505b3875e1db-kube-api-access-2n22r\") pod \"opendatahub-operator-controller-manager-5678f4b79b-xmbqt\" (UID: \"b013a5a0-f6b8-4489-8553-505b3875e1db\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:08:00.012754 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:00.012663 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b013a5a0-f6b8-4489-8553-505b3875e1db-webhook-cert\") pod \"opendatahub-operator-controller-manager-5678f4b79b-xmbqt\" (UID: \"b013a5a0-f6b8-4489-8553-505b3875e1db\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:08:00.012754 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:00.012712 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b013a5a0-f6b8-4489-8553-505b3875e1db-manifests\") pod \"opendatahub-operator-controller-manager-5678f4b79b-xmbqt\" (UID: \"b013a5a0-f6b8-4489-8553-505b3875e1db\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:08:00.012754 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:00.012734 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b013a5a0-f6b8-4489-8553-505b3875e1db-tmp\") pod \"opendatahub-operator-controller-manager-5678f4b79b-xmbqt\" (UID: \"b013a5a0-f6b8-4489-8553-505b3875e1db\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:08:00.013007 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:00.012760 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b013a5a0-f6b8-4489-8553-505b3875e1db-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5678f4b79b-xmbqt\" (UID: \"b013a5a0-f6b8-4489-8553-505b3875e1db\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:08:00.013007 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:00.012800 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2n22r\" (UniqueName: \"kubernetes.io/projected/b013a5a0-f6b8-4489-8553-505b3875e1db-kube-api-access-2n22r\") pod \"opendatahub-operator-controller-manager-5678f4b79b-xmbqt\" (UID: \"b013a5a0-f6b8-4489-8553-505b3875e1db\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:08:00.013182 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:00.013115 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b013a5a0-f6b8-4489-8553-505b3875e1db-manifests\") pod \"opendatahub-operator-controller-manager-5678f4b79b-xmbqt\" (UID: \"b013a5a0-f6b8-4489-8553-505b3875e1db\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:08:00.015165 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:00.015138 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b013a5a0-f6b8-4489-8553-505b3875e1db-tmp\") pod \"opendatahub-operator-controller-manager-5678f4b79b-xmbqt\" (UID: \"b013a5a0-f6b8-4489-8553-505b3875e1db\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:08:00.015275 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:00.015205 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b013a5a0-f6b8-4489-8553-505b3875e1db-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5678f4b79b-xmbqt\" (UID: \"b013a5a0-f6b8-4489-8553-505b3875e1db\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:08:00.015389 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:00.015279 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b013a5a0-f6b8-4489-8553-505b3875e1db-webhook-cert\") pod \"opendatahub-operator-controller-manager-5678f4b79b-xmbqt\" (UID: \"b013a5a0-f6b8-4489-8553-505b3875e1db\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:08:00.026885 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:00.026865 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n22r\" (UniqueName: \"kubernetes.io/projected/b013a5a0-f6b8-4489-8553-505b3875e1db-kube-api-access-2n22r\") pod \"opendatahub-operator-controller-manager-5678f4b79b-xmbqt\" (UID: \"b013a5a0-f6b8-4489-8553-505b3875e1db\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:08:00.057858 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:00.057838 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:08:00.200836 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:00.200806 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt"] Jun 03 15:08:00.203466 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:08:00.203438 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb013a5a0_f6b8_4489_8553_505b3875e1db.slice/crio-9503fe6a82043cdf23e094141a2c035072b2650cb8c32fbfb887ef41f6876019 WatchSource:0}: Error finding container 9503fe6a82043cdf23e094141a2c035072b2650cb8c32fbfb887ef41f6876019: Status 404 returned error can't find the container with id 9503fe6a82043cdf23e094141a2c035072b2650cb8c32fbfb887ef41f6876019 Jun 03 15:08:00.205103 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:00.205088 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:08:00.533917 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:00.533878 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" event={"ID":"b013a5a0-f6b8-4489-8553-505b3875e1db","Type":"ContainerStarted","Data":"9503fe6a82043cdf23e094141a2c035072b2650cb8c32fbfb887ef41f6876019"} Jun 03 15:08:03.545766 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:03.545681 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" event={"ID":"b013a5a0-f6b8-4489-8553-505b3875e1db","Type":"ContainerStarted","Data":"2c4401c198a0e95fa358d7e2033f1b043f246aa5872e5c054e2bf6af14ddcbfa"} Jun 03 15:08:04.549992 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:04.549921 2577 generic.go:358] "Generic (PLEG): container finished" podID="b013a5a0-f6b8-4489-8553-505b3875e1db" containerID="2c4401c198a0e95fa358d7e2033f1b043f246aa5872e5c054e2bf6af14ddcbfa" exitCode=0 Jun 03 15:08:04.550321 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:04.549995 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" event={"ID":"b013a5a0-f6b8-4489-8553-505b3875e1db","Type":"ContainerDied","Data":"2c4401c198a0e95fa358d7e2033f1b043f246aa5872e5c054e2bf6af14ddcbfa"} Jun 03 15:08:05.556002 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:05.555964 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" event={"ID":"b013a5a0-f6b8-4489-8553-505b3875e1db","Type":"ContainerStarted","Data":"dcb1cb94958055a0964a46ecc2446cab5bbd9c56acf0245ee16f34573a7def83"} Jun 03 15:08:05.556503 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:05.556079 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:08:05.602300 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:05.602254 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" podStartSLOduration=1.948896073 podStartE2EDuration="6.602242647s" podCreationTimestamp="2026-06-03 15:07:59 +0000 UTC" firstStartedPulling="2026-06-03 15:08:00.205216247 +0000 UTC m=+307.558186250" lastFinishedPulling="2026-06-03 15:08:04.858562808 +0000 UTC m=+312.211532824" observedRunningTime="2026-06-03 15:08:05.60046057 +0000 UTC m=+312.953430598" watchObservedRunningTime="2026-06-03 15:08:05.602242647 +0000 UTC m=+312.955212673" Jun 03 15:08:16.561698 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:16.561668 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-xmbqt" Jun 03 15:08:19.930881 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:19.930845 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl"] Jun 03 15:08:19.938257 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:19.938232 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" Jun 03 15:08:19.951477 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:19.951453 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 15:08:19.952697 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:19.952665 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 15:08:19.952820 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:19.952728 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 15:08:19.952820 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:19.952750 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:08:19.952820 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:19.952776 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 15:08:19.953046 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:19.953024 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-v6lrr\"" Jun 03 15:08:19.954562 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:19.954546 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl"] Jun 03 15:08:19.966280 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:19.966258 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdzck\" (UniqueName: \"kubernetes.io/projected/89981a83-40eb-4720-ac96-980e8841a650-kube-api-access-gdzck\") pod \"lws-controller-manager-f7c5db56c-w58hl\" (UID: \"89981a83-40eb-4720-ac96-980e8841a650\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" Jun 03 15:08:19.966395 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:19.966298 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/89981a83-40eb-4720-ac96-980e8841a650-manager-config\") pod \"lws-controller-manager-f7c5db56c-w58hl\" (UID: \"89981a83-40eb-4720-ac96-980e8841a650\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" Jun 03 15:08:19.966395 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:19.966322 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89981a83-40eb-4720-ac96-980e8841a650-cert\") pod \"lws-controller-manager-f7c5db56c-w58hl\" (UID: \"89981a83-40eb-4720-ac96-980e8841a650\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" Jun 03 15:08:19.966478 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:19.966435 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/89981a83-40eb-4720-ac96-980e8841a650-metrics-cert\") pod \"lws-controller-manager-f7c5db56c-w58hl\" (UID: \"89981a83-40eb-4720-ac96-980e8841a650\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" Jun 03 15:08:20.067096 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:20.067064 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gdzck\" (UniqueName: \"kubernetes.io/projected/89981a83-40eb-4720-ac96-980e8841a650-kube-api-access-gdzck\") pod \"lws-controller-manager-f7c5db56c-w58hl\" (UID: \"89981a83-40eb-4720-ac96-980e8841a650\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" Jun 03 15:08:20.067263 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:20.067106 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/89981a83-40eb-4720-ac96-980e8841a650-manager-config\") pod \"lws-controller-manager-f7c5db56c-w58hl\" (UID: \"89981a83-40eb-4720-ac96-980e8841a650\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" Jun 03 15:08:20.067263 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:20.067127 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89981a83-40eb-4720-ac96-980e8841a650-cert\") pod \"lws-controller-manager-f7c5db56c-w58hl\" (UID: \"89981a83-40eb-4720-ac96-980e8841a650\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" Jun 03 15:08:20.067263 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:20.067172 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/89981a83-40eb-4720-ac96-980e8841a650-metrics-cert\") pod \"lws-controller-manager-f7c5db56c-w58hl\" (UID: \"89981a83-40eb-4720-ac96-980e8841a650\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" Jun 03 15:08:20.067827 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:20.067804 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/89981a83-40eb-4720-ac96-980e8841a650-manager-config\") pod \"lws-controller-manager-f7c5db56c-w58hl\" (UID: \"89981a83-40eb-4720-ac96-980e8841a650\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" Jun 03 15:08:20.069665 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:20.069645 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/89981a83-40eb-4720-ac96-980e8841a650-metrics-cert\") pod \"lws-controller-manager-f7c5db56c-w58hl\" (UID: \"89981a83-40eb-4720-ac96-980e8841a650\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" Jun 03 15:08:20.069665 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:20.069657 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89981a83-40eb-4720-ac96-980e8841a650-cert\") pod \"lws-controller-manager-f7c5db56c-w58hl\" (UID: \"89981a83-40eb-4720-ac96-980e8841a650\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" Jun 03 15:08:20.109621 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:20.109596 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdzck\" (UniqueName: \"kubernetes.io/projected/89981a83-40eb-4720-ac96-980e8841a650-kube-api-access-gdzck\") pod \"lws-controller-manager-f7c5db56c-w58hl\" (UID: \"89981a83-40eb-4720-ac96-980e8841a650\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" Jun 03 15:08:20.246790 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:20.246715 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" Jun 03 15:08:20.394273 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:08:20.394245 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89981a83_40eb_4720_ac96_980e8841a650.slice/crio-95f7bce06b5aa91e2cf0c01885365abd018c33e1d7e9b2b17373286920d40851 WatchSource:0}: Error finding container 95f7bce06b5aa91e2cf0c01885365abd018c33e1d7e9b2b17373286920d40851: Status 404 returned error can't find the container with id 95f7bce06b5aa91e2cf0c01885365abd018c33e1d7e9b2b17373286920d40851 Jun 03 15:08:20.398152 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:20.398129 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl"] Jun 03 15:08:20.605167 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:20.605114 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" event={"ID":"89981a83-40eb-4720-ac96-980e8841a650","Type":"ContainerStarted","Data":"95f7bce06b5aa91e2cf0c01885365abd018c33e1d7e9b2b17373286920d40851"} Jun 03 15:08:23.618612 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:23.618581 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" event={"ID":"89981a83-40eb-4720-ac96-980e8841a650","Type":"ContainerStarted","Data":"d3675f071397e87550499ddb9dc2beed1e12e7474fb475ad2ce129e01726f44f"} Jun 03 15:08:23.618976 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:23.618735 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" Jun 03 15:08:23.644106 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:23.644050 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" podStartSLOduration=2.139069234 podStartE2EDuration="4.644036512s" podCreationTimestamp="2026-06-03 15:08:19 +0000 UTC" firstStartedPulling="2026-06-03 15:08:20.396471525 +0000 UTC m=+327.749441544" lastFinishedPulling="2026-06-03 15:08:22.901438819 +0000 UTC m=+330.254408822" observedRunningTime="2026-06-03 15:08:23.643120282 +0000 UTC m=+330.996090309" watchObservedRunningTime="2026-06-03 15:08:23.644036512 +0000 UTC m=+330.997006540" Jun 03 15:08:34.623936 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:34.623906 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-w58hl" Jun 03 15:08:50.092025 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:50.091987 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-86b6644fd4-zwskc"] Jun 03 15:08:50.095343 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:50.095323 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-86b6644fd4-zwskc" Jun 03 15:08:50.098036 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:50.098012 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 15:08:50.098155 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:50.098017 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rtrn8\"" Jun 03 15:08:50.103913 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:50.103892 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-86b6644fd4-zwskc"] Jun 03 15:08:50.228096 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:50.228062 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg792\" (UniqueName: \"kubernetes.io/projected/569410a7-77e5-4c6e-924c-0d8039a34284-kube-api-access-fg792\") pod \"dashboard-redirect-86b6644fd4-zwskc\" (UID: \"569410a7-77e5-4c6e-924c-0d8039a34284\") " pod="opendatahub/dashboard-redirect-86b6644fd4-zwskc" Jun 03 15:08:50.228264 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:50.228130 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/569410a7-77e5-4c6e-924c-0d8039a34284-redirect-config\") pod \"dashboard-redirect-86b6644fd4-zwskc\" (UID: \"569410a7-77e5-4c6e-924c-0d8039a34284\") " pod="opendatahub/dashboard-redirect-86b6644fd4-zwskc" Jun 03 15:08:50.329506 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:50.329477 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fg792\" (UniqueName: \"kubernetes.io/projected/569410a7-77e5-4c6e-924c-0d8039a34284-kube-api-access-fg792\") pod \"dashboard-redirect-86b6644fd4-zwskc\" (UID: \"569410a7-77e5-4c6e-924c-0d8039a34284\") " pod="opendatahub/dashboard-redirect-86b6644fd4-zwskc" Jun 03 15:08:50.329652 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:50.329525 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/569410a7-77e5-4c6e-924c-0d8039a34284-redirect-config\") pod \"dashboard-redirect-86b6644fd4-zwskc\" (UID: \"569410a7-77e5-4c6e-924c-0d8039a34284\") " pod="opendatahub/dashboard-redirect-86b6644fd4-zwskc" Jun 03 15:08:50.330150 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:50.330132 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/569410a7-77e5-4c6e-924c-0d8039a34284-redirect-config\") pod \"dashboard-redirect-86b6644fd4-zwskc\" (UID: \"569410a7-77e5-4c6e-924c-0d8039a34284\") " pod="opendatahub/dashboard-redirect-86b6644fd4-zwskc" Jun 03 15:08:50.338526 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:50.338503 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg792\" (UniqueName: \"kubernetes.io/projected/569410a7-77e5-4c6e-924c-0d8039a34284-kube-api-access-fg792\") pod \"dashboard-redirect-86b6644fd4-zwskc\" (UID: \"569410a7-77e5-4c6e-924c-0d8039a34284\") " pod="opendatahub/dashboard-redirect-86b6644fd4-zwskc" Jun 03 15:08:50.406337 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:50.406311 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-86b6644fd4-zwskc" Jun 03 15:08:50.532309 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:50.532284 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-86b6644fd4-zwskc"] Jun 03 15:08:50.534758 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:08:50.534730 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod569410a7_77e5_4c6e_924c_0d8039a34284.slice/crio-7dea8bca8fa6605b2e670aea4aaeca24fae7d336606ae195f86170b026d022e3 WatchSource:0}: Error finding container 7dea8bca8fa6605b2e670aea4aaeca24fae7d336606ae195f86170b026d022e3: Status 404 returned error can't find the container with id 7dea8bca8fa6605b2e670aea4aaeca24fae7d336606ae195f86170b026d022e3 Jun 03 15:08:50.713604 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:50.713525 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-86b6644fd4-zwskc" event={"ID":"569410a7-77e5-4c6e-924c-0d8039a34284","Type":"ContainerStarted","Data":"7dea8bca8fa6605b2e670aea4aaeca24fae7d336606ae195f86170b026d022e3"} Jun 03 15:08:56.739221 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:56.739181 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-86b6644fd4-zwskc" event={"ID":"569410a7-77e5-4c6e-924c-0d8039a34284","Type":"ContainerStarted","Data":"1998bba5dbca2664295c194d50725e40f96c77b3fe311d74cc02e99c725590bc"} Jun 03 15:08:56.769072 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:08:56.769022 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-86b6644fd4-zwskc" podStartSLOduration=1.6383294830000001 podStartE2EDuration="6.76900889s" podCreationTimestamp="2026-06-03 15:08:50 +0000 UTC" firstStartedPulling="2026-06-03 15:08:50.535940906 +0000 UTC m=+357.888910909" lastFinishedPulling="2026-06-03 15:08:55.666620313 +0000 UTC m=+363.019590316" observedRunningTime="2026-06-03 15:08:56.765061888 +0000 UTC m=+364.118031908" watchObservedRunningTime="2026-06-03 15:08:56.76900889 +0000 UTC m=+364.121978940" Jun 03 15:09:15.551909 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.551874 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d"] Jun 03 15:09:15.555192 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.555171 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.557959 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.557935 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 15:09:15.558529 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.558505 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-n4lr8\"" Jun 03 15:09:15.566288 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.566263 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d"] Jun 03 15:09:15.623741 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.623714 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.623873 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.623747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.623873 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.623786 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.623949 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.623881 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.623949 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.623934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pgds\" (UniqueName: \"kubernetes.io/projected/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-kube-api-access-6pgds\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.624013 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.623982 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.624046 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.624010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.624079 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.624050 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.624115 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.624077 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.725012 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.724981 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.725012 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.725017 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.725249 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.725155 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.725249 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.725194 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.725359 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.725249 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.725359 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.725279 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.725359 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.725311 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pgds\" (UniqueName: \"kubernetes.io/projected/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-kube-api-access-6pgds\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.725540 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.725359 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.725540 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.725414 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.725540 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.725456 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.725770 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.725746 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.725923 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.725897 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.726012 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.725990 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.726202 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.726184 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.727512 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.727492 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.728076 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.728062 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.734972 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.734951 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.735291 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.735271 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pgds\" (UniqueName: \"kubernetes.io/projected/1a0e8bea-3b2e-4f74-8efe-f831da6478b9-kube-api-access-6pgds\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d\" (UID: \"1a0e8bea-3b2e-4f74-8efe-f831da6478b9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:15.871338 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:15.871306 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:16.038346 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:16.038323 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d"] Jun 03 15:09:16.041006 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:09:16.040977 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a0e8bea_3b2e_4f74_8efe_f831da6478b9.slice/crio-5584d10c622d7ef6ffd33b3e2796084727390540f9bfcf52a9b2ba8f74b61262 WatchSource:0}: Error finding container 5584d10c622d7ef6ffd33b3e2796084727390540f9bfcf52a9b2ba8f74b61262: Status 404 returned error can't find the container with id 5584d10c622d7ef6ffd33b3e2796084727390540f9bfcf52a9b2ba8f74b61262 Jun 03 15:09:16.804654 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:16.804618 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" event={"ID":"1a0e8bea-3b2e-4f74-8efe-f831da6478b9","Type":"ContainerStarted","Data":"5584d10c622d7ef6ffd33b3e2796084727390540f9bfcf52a9b2ba8f74b61262"} Jun 03 15:09:18.825955 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:18.825917 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 15:09:18.826228 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:18.825992 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 15:09:18.826228 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:18.826020 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 15:09:19.816261 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:19.816218 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" event={"ID":"1a0e8bea-3b2e-4f74-8efe-f831da6478b9","Type":"ContainerStarted","Data":"302d89fd25b92310de56a0b66716bded049dcb20ea263acf00bce700ac236f0b"} Jun 03 15:09:19.840869 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:19.840816 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" podStartSLOduration=2.057940616 podStartE2EDuration="4.84080003s" podCreationTimestamp="2026-06-03 15:09:15 +0000 UTC" firstStartedPulling="2026-06-03 15:09:16.042755794 +0000 UTC m=+383.395725801" lastFinishedPulling="2026-06-03 15:09:18.825615205 +0000 UTC m=+386.178585215" observedRunningTime="2026-06-03 15:09:19.840529408 +0000 UTC m=+387.193499444" watchObservedRunningTime="2026-06-03 15:09:19.84080003 +0000 UTC m=+387.193770057" Jun 03 15:09:19.871439 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:19.871411 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:19.876017 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:19.875992 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:20.820006 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:20.819978 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:20.821037 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:20.821018 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d" Jun 03 15:09:39.584087 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.584052 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-584846b987-l267v"] Jun 03 15:09:39.587424 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.587402 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.604006 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.603957 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-584846b987-l267v"] Jun 03 15:09:39.729236 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.729204 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9626509-656a-4962-927c-7edeb67d4f3a-service-ca\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.729439 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.729255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9626509-656a-4962-927c-7edeb67d4f3a-console-oauth-config\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.729439 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.729273 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9626509-656a-4962-927c-7edeb67d4f3a-console-config\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.729439 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.729295 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtmjh\" (UniqueName: \"kubernetes.io/projected/c9626509-656a-4962-927c-7edeb67d4f3a-kube-api-access-wtmjh\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.729439 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.729337 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9626509-656a-4962-927c-7edeb67d4f3a-oauth-serving-cert\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.729439 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.729412 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9626509-656a-4962-927c-7edeb67d4f3a-trusted-ca-bundle\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.729637 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.729444 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9626509-656a-4962-927c-7edeb67d4f3a-console-serving-cert\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.830868 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.830830 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9626509-656a-4962-927c-7edeb67d4f3a-service-ca\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.831037 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.830881 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9626509-656a-4962-927c-7edeb67d4f3a-console-oauth-config\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.831037 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.830898 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9626509-656a-4962-927c-7edeb67d4f3a-console-config\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.831037 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.830920 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtmjh\" (UniqueName: \"kubernetes.io/projected/c9626509-656a-4962-927c-7edeb67d4f3a-kube-api-access-wtmjh\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.831037 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.830961 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9626509-656a-4962-927c-7edeb67d4f3a-oauth-serving-cert\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.831037 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.831000 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9626509-656a-4962-927c-7edeb67d4f3a-trusted-ca-bundle\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.831037 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.831027 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9626509-656a-4962-927c-7edeb67d4f3a-console-serving-cert\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.831706 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.831676 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9626509-656a-4962-927c-7edeb67d4f3a-service-ca\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.831812 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.831686 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9626509-656a-4962-927c-7edeb67d4f3a-console-config\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.831812 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.831740 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9626509-656a-4962-927c-7edeb67d4f3a-oauth-serving-cert\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.831986 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.831962 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9626509-656a-4962-927c-7edeb67d4f3a-trusted-ca-bundle\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.833466 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.833440 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9626509-656a-4962-927c-7edeb67d4f3a-console-oauth-config\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.833572 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.833547 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9626509-656a-4962-927c-7edeb67d4f3a-console-serving-cert\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.840187 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.840140 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtmjh\" (UniqueName: \"kubernetes.io/projected/c9626509-656a-4962-927c-7edeb67d4f3a-kube-api-access-wtmjh\") pod \"console-584846b987-l267v\" (UID: \"c9626509-656a-4962-927c-7edeb67d4f3a\") " pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:39.900415 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:39.900391 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:40.040904 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:40.040856 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-584846b987-l267v"] Jun 03 15:09:40.043422 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:09:40.043394 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9626509_656a_4962_927c_7edeb67d4f3a.slice/crio-13caf5bb6e44b13242caae38ed9fd3284e2c5d56b295e4d7edd4cde616ce7932 WatchSource:0}: Error finding container 13caf5bb6e44b13242caae38ed9fd3284e2c5d56b295e4d7edd4cde616ce7932: Status 404 returned error can't find the container with id 13caf5bb6e44b13242caae38ed9fd3284e2c5d56b295e4d7edd4cde616ce7932 Jun 03 15:09:40.888383 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:40.888330 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584846b987-l267v" event={"ID":"c9626509-656a-4962-927c-7edeb67d4f3a","Type":"ContainerStarted","Data":"002ad227b78863cdf6ab201909be5050ef6d95b2e4464da1da5c4866445d93f6"} Jun 03 15:09:40.888383 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:40.888388 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584846b987-l267v" event={"ID":"c9626509-656a-4962-927c-7edeb67d4f3a","Type":"ContainerStarted","Data":"13caf5bb6e44b13242caae38ed9fd3284e2c5d56b295e4d7edd4cde616ce7932"} Jun 03 15:09:40.910791 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:40.910742 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-584846b987-l267v" podStartSLOduration=1.910726129 podStartE2EDuration="1.910726129s" podCreationTimestamp="2026-06-03 15:09:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:09:40.90804408 +0000 UTC m=+408.261014143" watchObservedRunningTime="2026-06-03 15:09:40.910726129 +0000 UTC m=+408.263696155" Jun 03 15:09:49.901256 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:49.901227 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:49.901256 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:49.901262 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:49.906115 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:49.906093 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:49.926914 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:49.926889 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-584846b987-l267v" Jun 03 15:09:49.986205 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:49.986167 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8576785654-zfb85"] Jun 03 15:09:59.958945 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:59.958912 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv"] Jun 03 15:09:59.963916 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:59.963899 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" Jun 03 15:09:59.966700 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:59.966680 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 15:09:59.967782 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:59.967766 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9v9hf\"" Jun 03 15:09:59.970149 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:59.970127 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 15:09:59.982874 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:09:59.982856 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv"] Jun 03 15:10:00.107787 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:00.107755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf45b\" (UniqueName: \"kubernetes.io/projected/6e09c0b6-e0d4-41c1-9486-f9f03144731b-kube-api-access-lf45b\") pod \"limitador-operator-controller-manager-85c4996f8c-znlcv\" (UID: \"6e09c0b6-e0d4-41c1-9486-f9f03144731b\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" Jun 03 15:10:00.208706 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:00.208676 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lf45b\" (UniqueName: \"kubernetes.io/projected/6e09c0b6-e0d4-41c1-9486-f9f03144731b-kube-api-access-lf45b\") pod \"limitador-operator-controller-manager-85c4996f8c-znlcv\" (UID: \"6e09c0b6-e0d4-41c1-9486-f9f03144731b\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" Jun 03 15:10:00.220161 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:00.220093 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf45b\" (UniqueName: \"kubernetes.io/projected/6e09c0b6-e0d4-41c1-9486-f9f03144731b-kube-api-access-lf45b\") pod \"limitador-operator-controller-manager-85c4996f8c-znlcv\" (UID: \"6e09c0b6-e0d4-41c1-9486-f9f03144731b\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" Jun 03 15:10:00.273831 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:00.273808 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" Jun 03 15:10:00.431111 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:00.431073 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv"] Jun 03 15:10:00.435035 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:10:00.435008 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e09c0b6_e0d4_41c1_9486_f9f03144731b.slice/crio-8c0d229d8d945d070d55727538221ebaad4bc0a806fce3ac41ac411e1bbd3dc0 WatchSource:0}: Error finding container 8c0d229d8d945d070d55727538221ebaad4bc0a806fce3ac41ac411e1bbd3dc0: Status 404 returned error can't find the container with id 8c0d229d8d945d070d55727538221ebaad4bc0a806fce3ac41ac411e1bbd3dc0 Jun 03 15:10:00.957739 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:00.957709 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" event={"ID":"6e09c0b6-e0d4-41c1-9486-f9f03144731b","Type":"ContainerStarted","Data":"8c0d229d8d945d070d55727538221ebaad4bc0a806fce3ac41ac411e1bbd3dc0"} Jun 03 15:10:02.965739 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:02.965705 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" event={"ID":"6e09c0b6-e0d4-41c1-9486-f9f03144731b","Type":"ContainerStarted","Data":"f61204ba915eb3810f45c8c7cc7d3cb70d0ac4fd2f6654643640b75bde4cafa3"} Jun 03 15:10:02.966108 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:02.965758 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" Jun 03 15:10:02.992614 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:02.992564 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" podStartSLOduration=1.5564634019999999 podStartE2EDuration="3.992550085s" podCreationTimestamp="2026-06-03 15:09:59 +0000 UTC" firstStartedPulling="2026-06-03 15:10:00.437027651 +0000 UTC m=+427.789997655" lastFinishedPulling="2026-06-03 15:10:02.873114334 +0000 UTC m=+430.226084338" observedRunningTime="2026-06-03 15:10:02.990672959 +0000 UTC m=+430.343642989" watchObservedRunningTime="2026-06-03 15:10:02.992550085 +0000 UTC m=+430.345520111" Jun 03 15:10:13.971909 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:13.971836 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" Jun 03 15:10:15.013909 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.013835 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-8576785654-zfb85" podUID="e40aff1f-c0bf-4c39-8e11-4d761c748c37" containerName="console" containerID="cri-o://c4b411362a59978a063e498b28f37237b4a61e94880690f0da1548feb1916dee" gracePeriod=15 Jun 03 15:10:15.266456 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.266394 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8576785654-zfb85_e40aff1f-c0bf-4c39-8e11-4d761c748c37/console/0.log" Jun 03 15:10:15.266563 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.266467 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8576785654-zfb85" Jun 03 15:10:15.315265 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.315233 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e40aff1f-c0bf-4c39-8e11-4d761c748c37-console-serving-cert\") pod \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " Jun 03 15:10:15.315265 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.315270 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87rrv\" (UniqueName: \"kubernetes.io/projected/e40aff1f-c0bf-4c39-8e11-4d761c748c37-kube-api-access-87rrv\") pod \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " Jun 03 15:10:15.315527 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.315290 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-console-config\") pod \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " Jun 03 15:10:15.315527 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.315314 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-service-ca\") pod \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " Jun 03 15:10:15.315527 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.315333 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-trusted-ca-bundle\") pod \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " Jun 03 15:10:15.315723 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.315589 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-oauth-serving-cert\") pod \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " Jun 03 15:10:15.315723 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.315672 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e40aff1f-c0bf-4c39-8e11-4d761c748c37-console-oauth-config\") pod \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\" (UID: \"e40aff1f-c0bf-4c39-8e11-4d761c748c37\") " Jun 03 15:10:15.315828 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.315770 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-service-ca" (OuterVolumeSpecName: "service-ca") pod "e40aff1f-c0bf-4c39-8e11-4d761c748c37" (UID: "e40aff1f-c0bf-4c39-8e11-4d761c748c37"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:10:15.315828 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.315783 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-console-config" (OuterVolumeSpecName: "console-config") pod "e40aff1f-c0bf-4c39-8e11-4d761c748c37" (UID: "e40aff1f-c0bf-4c39-8e11-4d761c748c37"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:10:15.315941 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.315920 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e40aff1f-c0bf-4c39-8e11-4d761c748c37" (UID: "e40aff1f-c0bf-4c39-8e11-4d761c748c37"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:10:15.315996 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.315972 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e40aff1f-c0bf-4c39-8e11-4d761c748c37" (UID: "e40aff1f-c0bf-4c39-8e11-4d761c748c37"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:10:15.316160 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.316139 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-console-config\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:10:15.316265 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.316166 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-service-ca\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:10:15.316265 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.316179 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-trusted-ca-bundle\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:10:15.316265 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.316194 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e40aff1f-c0bf-4c39-8e11-4d761c748c37-oauth-serving-cert\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:10:15.317844 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.317824 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e40aff1f-c0bf-4c39-8e11-4d761c748c37-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e40aff1f-c0bf-4c39-8e11-4d761c748c37" (UID: "e40aff1f-c0bf-4c39-8e11-4d761c748c37"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:10:15.318053 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.318030 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e40aff1f-c0bf-4c39-8e11-4d761c748c37-kube-api-access-87rrv" (OuterVolumeSpecName: "kube-api-access-87rrv") pod "e40aff1f-c0bf-4c39-8e11-4d761c748c37" (UID: "e40aff1f-c0bf-4c39-8e11-4d761c748c37"). InnerVolumeSpecName "kube-api-access-87rrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:10:15.318121 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.318104 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e40aff1f-c0bf-4c39-8e11-4d761c748c37-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e40aff1f-c0bf-4c39-8e11-4d761c748c37" (UID: "e40aff1f-c0bf-4c39-8e11-4d761c748c37"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:10:15.416682 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.416649 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87rrv\" (UniqueName: \"kubernetes.io/projected/e40aff1f-c0bf-4c39-8e11-4d761c748c37-kube-api-access-87rrv\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:10:15.416682 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.416679 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e40aff1f-c0bf-4c39-8e11-4d761c748c37-console-oauth-config\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:10:15.416682 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:15.416689 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e40aff1f-c0bf-4c39-8e11-4d761c748c37-console-serving-cert\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:10:16.011693 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:16.011662 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8576785654-zfb85_e40aff1f-c0bf-4c39-8e11-4d761c748c37/console/0.log" Jun 03 15:10:16.011854 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:16.011702 2577 generic.go:358] "Generic (PLEG): container finished" podID="e40aff1f-c0bf-4c39-8e11-4d761c748c37" containerID="c4b411362a59978a063e498b28f37237b4a61e94880690f0da1548feb1916dee" exitCode=2 Jun 03 15:10:16.011854 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:16.011756 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8576785654-zfb85" event={"ID":"e40aff1f-c0bf-4c39-8e11-4d761c748c37","Type":"ContainerDied","Data":"c4b411362a59978a063e498b28f37237b4a61e94880690f0da1548feb1916dee"} Jun 03 15:10:16.011854 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:16.011763 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8576785654-zfb85" Jun 03 15:10:16.011854 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:16.011787 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8576785654-zfb85" event={"ID":"e40aff1f-c0bf-4c39-8e11-4d761c748c37","Type":"ContainerDied","Data":"011f80ae5ff4b7b81cb01edb2675ff228dabf692a8b4a373ddc18ac8ce93d2bd"} Jun 03 15:10:16.011854 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:16.011803 2577 scope.go:117] "RemoveContainer" containerID="c4b411362a59978a063e498b28f37237b4a61e94880690f0da1548feb1916dee" Jun 03 15:10:16.020844 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:16.020679 2577 scope.go:117] "RemoveContainer" containerID="c4b411362a59978a063e498b28f37237b4a61e94880690f0da1548feb1916dee" Jun 03 15:10:16.021059 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:10:16.020915 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4b411362a59978a063e498b28f37237b4a61e94880690f0da1548feb1916dee\": container with ID starting with c4b411362a59978a063e498b28f37237b4a61e94880690f0da1548feb1916dee not found: ID does not exist" containerID="c4b411362a59978a063e498b28f37237b4a61e94880690f0da1548feb1916dee" Jun 03 15:10:16.021059 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:16.020943 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4b411362a59978a063e498b28f37237b4a61e94880690f0da1548feb1916dee"} err="failed to get container status \"c4b411362a59978a063e498b28f37237b4a61e94880690f0da1548feb1916dee\": rpc error: code = NotFound desc = could not find container \"c4b411362a59978a063e498b28f37237b4a61e94880690f0da1548feb1916dee\": container with ID starting with c4b411362a59978a063e498b28f37237b4a61e94880690f0da1548feb1916dee not found: ID does not exist" Jun 03 15:10:16.050773 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:16.050748 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8576785654-zfb85"] Jun 03 15:10:16.059642 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:16.059621 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8576785654-zfb85"] Jun 03 15:10:17.244241 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.244210 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e40aff1f-c0bf-4c39-8e11-4d761c748c37" path="/var/lib/kubelet/pods/e40aff1f-c0bf-4c39-8e11-4d761c748c37/volumes" Jun 03 15:10:17.646033 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.646000 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv"] Jun 03 15:10:17.646293 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.646267 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" podUID="6e09c0b6-e0d4-41c1-9486-f9f03144731b" containerName="manager" containerID="cri-o://f61204ba915eb3810f45c8c7cc7d3cb70d0ac4fd2f6654643640b75bde4cafa3" gracePeriod=2 Jun 03 15:10:17.651439 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.651401 2577 status_manager.go:895] "Failed to get status for pod" podUID="6e09c0b6-e0d4-41c1-9486-f9f03144731b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" err="pods \"limitador-operator-controller-manager-85c4996f8c-znlcv\" is forbidden: User \"system:node:ip-10-0-130-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-78.ec2.internal' and this object" Jun 03 15:10:17.652072 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.652050 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv"] Jun 03 15:10:17.726839 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.726809 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pp97q"] Jun 03 15:10:17.727173 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.727157 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40aff1f-c0bf-4c39-8e11-4d761c748c37" containerName="console" Jun 03 15:10:17.727242 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.727175 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40aff1f-c0bf-4c39-8e11-4d761c748c37" containerName="console" Jun 03 15:10:17.727242 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.727187 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e09c0b6-e0d4-41c1-9486-f9f03144731b" containerName="manager" Jun 03 15:10:17.727242 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.727195 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e09c0b6-e0d4-41c1-9486-f9f03144731b" containerName="manager" Jun 03 15:10:17.727407 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.727271 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="6e09c0b6-e0d4-41c1-9486-f9f03144731b" containerName="manager" Jun 03 15:10:17.727407 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.727283 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="e40aff1f-c0bf-4c39-8e11-4d761c748c37" containerName="console" Jun 03 15:10:17.729312 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.729288 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pp97q" Jun 03 15:10:17.732044 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.732019 2577 status_manager.go:895] "Failed to get status for pod" podUID="6e09c0b6-e0d4-41c1-9486-f9f03144731b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" err="pods \"limitador-operator-controller-manager-85c4996f8c-znlcv\" is forbidden: User \"system:node:ip-10-0-130-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-78.ec2.internal' and this object" Jun 03 15:10:17.738321 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.738289 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj6vb\" (UniqueName: \"kubernetes.io/projected/03089744-c8b1-4132-b429-601f8c753c6d-kube-api-access-jj6vb\") pod \"limitador-operator-controller-manager-85c4996f8c-pp97q\" (UID: \"03089744-c8b1-4132-b429-601f8c753c6d\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pp97q" Jun 03 15:10:17.776241 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.776207 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pp97q"] Jun 03 15:10:17.839039 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.839003 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jj6vb\" (UniqueName: \"kubernetes.io/projected/03089744-c8b1-4132-b429-601f8c753c6d-kube-api-access-jj6vb\") pod \"limitador-operator-controller-manager-85c4996f8c-pp97q\" (UID: \"03089744-c8b1-4132-b429-601f8c753c6d\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pp97q" Jun 03 15:10:17.872773 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.872741 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj6vb\" (UniqueName: \"kubernetes.io/projected/03089744-c8b1-4132-b429-601f8c753c6d-kube-api-access-jj6vb\") pod \"limitador-operator-controller-manager-85c4996f8c-pp97q\" (UID: \"03089744-c8b1-4132-b429-601f8c753c6d\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pp97q" Jun 03 15:10:17.884449 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.884429 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" Jun 03 15:10:17.887790 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.887763 2577 status_manager.go:895] "Failed to get status for pod" podUID="6e09c0b6-e0d4-41c1-9486-f9f03144731b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" err="pods \"limitador-operator-controller-manager-85c4996f8c-znlcv\" is forbidden: User \"system:node:ip-10-0-130-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-78.ec2.internal' and this object" Jun 03 15:10:17.940147 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.940070 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lf45b\" (UniqueName: \"kubernetes.io/projected/6e09c0b6-e0d4-41c1-9486-f9f03144731b-kube-api-access-lf45b\") pod \"6e09c0b6-e0d4-41c1-9486-f9f03144731b\" (UID: \"6e09c0b6-e0d4-41c1-9486-f9f03144731b\") " Jun 03 15:10:17.942250 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:17.942221 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e09c0b6-e0d4-41c1-9486-f9f03144731b-kube-api-access-lf45b" (OuterVolumeSpecName: "kube-api-access-lf45b") pod "6e09c0b6-e0d4-41c1-9486-f9f03144731b" (UID: "6e09c0b6-e0d4-41c1-9486-f9f03144731b"). InnerVolumeSpecName "kube-api-access-lf45b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:10:18.021521 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:18.021488 2577 generic.go:358] "Generic (PLEG): container finished" podID="6e09c0b6-e0d4-41c1-9486-f9f03144731b" containerID="f61204ba915eb3810f45c8c7cc7d3cb70d0ac4fd2f6654643640b75bde4cafa3" exitCode=0 Jun 03 15:10:18.021689 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:18.021535 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" Jun 03 15:10:18.021689 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:18.021555 2577 scope.go:117] "RemoveContainer" containerID="f61204ba915eb3810f45c8c7cc7d3cb70d0ac4fd2f6654643640b75bde4cafa3" Jun 03 15:10:18.024113 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:18.024089 2577 status_manager.go:895] "Failed to get status for pod" podUID="6e09c0b6-e0d4-41c1-9486-f9f03144731b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" err="pods \"limitador-operator-controller-manager-85c4996f8c-znlcv\" is forbidden: User \"system:node:ip-10-0-130-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-78.ec2.internal' and this object" Jun 03 15:10:18.030123 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:18.030105 2577 scope.go:117] "RemoveContainer" containerID="f61204ba915eb3810f45c8c7cc7d3cb70d0ac4fd2f6654643640b75bde4cafa3" Jun 03 15:10:18.030397 ip-10-0-130-78 kubenswrapper[2577]: E0603 15:10:18.030351 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f61204ba915eb3810f45c8c7cc7d3cb70d0ac4fd2f6654643640b75bde4cafa3\": container with ID starting with f61204ba915eb3810f45c8c7cc7d3cb70d0ac4fd2f6654643640b75bde4cafa3 not found: ID does not exist" containerID="f61204ba915eb3810f45c8c7cc7d3cb70d0ac4fd2f6654643640b75bde4cafa3" Jun 03 15:10:18.030480 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:18.030409 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f61204ba915eb3810f45c8c7cc7d3cb70d0ac4fd2f6654643640b75bde4cafa3"} err="failed to get container status \"f61204ba915eb3810f45c8c7cc7d3cb70d0ac4fd2f6654643640b75bde4cafa3\": rpc error: code = NotFound desc = could not find container \"f61204ba915eb3810f45c8c7cc7d3cb70d0ac4fd2f6654643640b75bde4cafa3\": container with ID starting with f61204ba915eb3810f45c8c7cc7d3cb70d0ac4fd2f6654643640b75bde4cafa3 not found: ID does not exist" Jun 03 15:10:18.032051 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:18.032028 2577 status_manager.go:895] "Failed to get status for pod" podUID="6e09c0b6-e0d4-41c1-9486-f9f03144731b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" err="pods \"limitador-operator-controller-manager-85c4996f8c-znlcv\" is forbidden: User \"system:node:ip-10-0-130-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-78.ec2.internal' and this object" Jun 03 15:10:18.040331 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:18.040309 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pp97q" Jun 03 15:10:18.040563 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:18.040547 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf45b\" (UniqueName: \"kubernetes.io/projected/6e09c0b6-e0d4-41c1-9486-f9f03144731b-kube-api-access-lf45b\") on node \"ip-10-0-130-78.ec2.internal\" DevicePath \"\"" Jun 03 15:10:18.176421 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:18.176388 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pp97q"] Jun 03 15:10:18.180320 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:10:18.180292 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03089744_c8b1_4132_b429_601f8c753c6d.slice/crio-8b45cb4314682e680280f7dffd0e8dde18cf58310516567f0301e4eacd66fd87 WatchSource:0}: Error finding container 8b45cb4314682e680280f7dffd0e8dde18cf58310516567f0301e4eacd66fd87: Status 404 returned error can't find the container with id 8b45cb4314682e680280f7dffd0e8dde18cf58310516567f0301e4eacd66fd87 Jun 03 15:10:19.031999 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:19.031953 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pp97q" event={"ID":"03089744-c8b1-4132-b429-601f8c753c6d","Type":"ContainerStarted","Data":"e5727846623f65515f4b7eaf9ac62c36e4346572fda71d889870120f25287c37"} Jun 03 15:10:19.031999 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:19.032004 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pp97q" event={"ID":"03089744-c8b1-4132-b429-601f8c753c6d","Type":"ContainerStarted","Data":"8b45cb4314682e680280f7dffd0e8dde18cf58310516567f0301e4eacd66fd87"} Jun 03 15:10:19.032555 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:19.032032 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pp97q" Jun 03 15:10:19.036284 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:19.036257 2577 status_manager.go:895] "Failed to get status for pod" podUID="6e09c0b6-e0d4-41c1-9486-f9f03144731b" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-znlcv" err="pods \"limitador-operator-controller-manager-85c4996f8c-znlcv\" is forbidden: User \"system:node:ip-10-0-130-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-78.ec2.internal' and this object" Jun 03 15:10:19.067016 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:19.066969 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pp97q" podStartSLOduration=2.066955076 podStartE2EDuration="2.066955076s" podCreationTimestamp="2026-06-03 15:10:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:10:19.065618961 +0000 UTC m=+446.418588988" watchObservedRunningTime="2026-06-03 15:10:19.066955076 +0000 UTC m=+446.419925175" Jun 03 15:10:19.243415 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:19.243353 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e09c0b6-e0d4-41c1-9486-f9f03144731b" path="/var/lib/kubelet/pods/6e09c0b6-e0d4-41c1-9486-f9f03144731b/volumes" Jun 03 15:10:30.038921 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:10:30.038890 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pp97q" Jun 03 15:11:00.278121 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.278089 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h"] Jun 03 15:11:00.282722 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.282703 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.288392 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.288353 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-d25bx\"" Jun 03 15:11:00.325606 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.325578 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h"] Jun 03 15:11:00.397538 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.397510 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.397695 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.397547 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.397695 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.397568 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.397695 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.397668 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.397868 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.397724 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxsnn\" (UniqueName: \"kubernetes.io/projected/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-kube-api-access-dxsnn\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.397868 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.397775 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.397868 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.397808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.397868 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.397854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.398024 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.397901 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.498967 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.498936 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.499130 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.498973 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.499130 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.498999 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.499254 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.499134 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.499254 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.499214 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.499403 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.499267 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dxsnn\" (UniqueName: \"kubernetes.io/projected/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-kube-api-access-dxsnn\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.499403 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.499306 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.499525 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.499412 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.499525 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.499418 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.499525 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.499491 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.499683 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.499602 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.499683 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.499650 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.499800 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.499782 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.499860 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.499790 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.501347 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.501320 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.501605 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.501588 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.507690 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.507667 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxsnn\" (UniqueName: \"kubernetes.io/projected/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-kube-api-access-dxsnn\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.512551 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.512530 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rpd8h\" (UID: \"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.593136 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.593058 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:00.738653 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.738623 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h"] Jun 03 15:11:00.743820 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:11:00.743790 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a78db9b_c9ad_47a2_b262_82ae9a6e9ed3.slice/crio-56ce19c6fcac160562181178c7d715ac813283a63446d3bbe5c22924c70fb124 WatchSource:0}: Error finding container 56ce19c6fcac160562181178c7d715ac813283a63446d3bbe5c22924c70fb124: Status 404 returned error can't find the container with id 56ce19c6fcac160562181178c7d715ac813283a63446d3bbe5c22924c70fb124 Jun 03 15:11:00.745942 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.745908 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 15:11:00.746056 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.745987 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 15:11:00.746056 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:00.746032 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 15:11:01.174917 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:01.174880 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" event={"ID":"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3","Type":"ContainerStarted","Data":"583a56b6646a8ed796688b5135b001917f33bd14be5ea2fbccd317068b103b3a"} Jun 03 15:11:01.174917 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:01.174920 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" event={"ID":"9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3","Type":"ContainerStarted","Data":"56ce19c6fcac160562181178c7d715ac813283a63446d3bbe5c22924c70fb124"} Jun 03 15:11:01.217098 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:01.217032 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" podStartSLOduration=1.217014744 podStartE2EDuration="1.217014744s" podCreationTimestamp="2026-06-03 15:11:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:11:01.21560655 +0000 UTC m=+488.568576576" watchObservedRunningTime="2026-06-03 15:11:01.217014744 +0000 UTC m=+488.569984772" Jun 03 15:11:01.594148 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:01.594059 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:01.598748 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:01.598722 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:02.179281 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:02.179253 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:02.180307 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:02.180286 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rpd8h" Jun 03 15:11:49.473888 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:49.473852 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-pjfxk"] Jun 03 15:11:49.477155 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:49.477138 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-pjfxk" Jun 03 15:11:49.480109 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:49.480088 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 15:11:49.480997 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:49.480981 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-vs8sg\"" Jun 03 15:11:49.481758 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:49.481744 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 15:11:49.510970 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:49.510945 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-pjfxk"] Jun 03 15:11:49.628377 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:49.628326 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjt4q\" (UniqueName: \"kubernetes.io/projected/66f7bfd7-9b9b-4957-ad50-4ff7e13deaed-kube-api-access-sjt4q\") pod \"keycloak-operator-7864d68cbd-pjfxk\" (UID: \"66f7bfd7-9b9b-4957-ad50-4ff7e13deaed\") " pod="keycloak-system/keycloak-operator-7864d68cbd-pjfxk" Jun 03 15:11:49.729718 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:49.729634 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjt4q\" (UniqueName: \"kubernetes.io/projected/66f7bfd7-9b9b-4957-ad50-4ff7e13deaed-kube-api-access-sjt4q\") pod \"keycloak-operator-7864d68cbd-pjfxk\" (UID: \"66f7bfd7-9b9b-4957-ad50-4ff7e13deaed\") " pod="keycloak-system/keycloak-operator-7864d68cbd-pjfxk" Jun 03 15:11:49.751423 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:49.751399 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjt4q\" (UniqueName: \"kubernetes.io/projected/66f7bfd7-9b9b-4957-ad50-4ff7e13deaed-kube-api-access-sjt4q\") pod \"keycloak-operator-7864d68cbd-pjfxk\" (UID: \"66f7bfd7-9b9b-4957-ad50-4ff7e13deaed\") " pod="keycloak-system/keycloak-operator-7864d68cbd-pjfxk" Jun 03 15:11:49.788321 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:49.788289 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-pjfxk" Jun 03 15:11:49.932433 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:49.932409 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-pjfxk"] Jun 03 15:11:49.934587 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:11:49.934561 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f7bfd7_9b9b_4957_ad50_4ff7e13deaed.slice/crio-0ed5c2dbe1524004464e2f4e0e78e5e934dcc199048b0f091e4af48bb8dd9ea1 WatchSource:0}: Error finding container 0ed5c2dbe1524004464e2f4e0e78e5e934dcc199048b0f091e4af48bb8dd9ea1: Status 404 returned error can't find the container with id 0ed5c2dbe1524004464e2f4e0e78e5e934dcc199048b0f091e4af48bb8dd9ea1 Jun 03 15:11:50.344827 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:50.344786 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-pjfxk" event={"ID":"66f7bfd7-9b9b-4957-ad50-4ff7e13deaed","Type":"ContainerStarted","Data":"0ed5c2dbe1524004464e2f4e0e78e5e934dcc199048b0f091e4af48bb8dd9ea1"} Jun 03 15:11:56.369673 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:56.369638 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-pjfxk" event={"ID":"66f7bfd7-9b9b-4957-ad50-4ff7e13deaed","Type":"ContainerStarted","Data":"bab71bf528626a304e3759d225e41e13303cfdb9b23e16d0e19e641301a087da"} Jun 03 15:11:56.405733 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:11:56.405688 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-pjfxk" podStartSLOduration=1.847269386 podStartE2EDuration="7.40567534s" podCreationTimestamp="2026-06-03 15:11:49 +0000 UTC" firstStartedPulling="2026-06-03 15:11:49.936015615 +0000 UTC m=+537.288985619" lastFinishedPulling="2026-06-03 15:11:55.494421566 +0000 UTC m=+542.847391573" observedRunningTime="2026-06-03 15:11:56.401227039 +0000 UTC m=+543.754197064" watchObservedRunningTime="2026-06-03 15:11:56.40567534 +0000 UTC m=+543.758645366" Jun 03 15:12:53.144485 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:12:53.144453 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hskk5_05144d0b-dd83-4d3c-9b43-4480b3fc8a35/console-operator/1.log" Jun 03 15:12:53.145969 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:12:53.145944 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hskk5_05144d0b-dd83-4d3c-9b43-4480b3fc8a35/console-operator/1.log" Jun 03 15:12:53.152359 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:12:53.152343 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfwpp_fbb6dd98-36d0-499e-99f8-422e02a621b3/ovn-acl-logging/0.log" Jun 03 15:12:53.154039 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:12:53.154023 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfwpp_fbb6dd98-36d0-499e-99f8-422e02a621b3/ovn-acl-logging/0.log" Jun 03 15:17:53.176514 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:17:53.176482 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hskk5_05144d0b-dd83-4d3c-9b43-4480b3fc8a35/console-operator/1.log" Jun 03 15:17:53.176967 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:17:53.176572 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hskk5_05144d0b-dd83-4d3c-9b43-4480b3fc8a35/console-operator/1.log" Jun 03 15:17:53.184543 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:17:53.184524 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfwpp_fbb6dd98-36d0-499e-99f8-422e02a621b3/ovn-acl-logging/0.log" Jun 03 15:17:53.184674 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:17:53.184523 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfwpp_fbb6dd98-36d0-499e-99f8-422e02a621b3/ovn-acl-logging/0.log" Jun 03 15:21:45.747798 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:45.747756 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-86b6644fd4-zwskc_569410a7-77e5-4c6e-924c-0d8039a34284/nginx/0.log" Jun 03 15:21:46.922985 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:46.922952 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5678f4b79b-xmbqt_b013a5a0-f6b8-4489-8553-505b3875e1db/copy-manifests/0.log" Jun 03 15:21:46.930792 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:46.930759 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5678f4b79b-xmbqt_b013a5a0-f6b8-4489-8553-505b3875e1db/manager/0.log" Jun 03 15:21:49.111943 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:49.111912 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-pp97q_03089744-c8b1-4132-b429-601f8c753c6d/manager/0.log" Jun 03 15:21:49.459115 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:49.459032 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d_1a0e8bea-3b2e-4f74-8efe-f831da6478b9/istio-proxy/0.log" Jun 03 15:21:49.927754 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:49.927726 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-rpd8h_9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3/istio-proxy/0.log" Jun 03 15:21:50.151374 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:50.151328 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64cd489db9-fdf9z_c6b8dc06-9393-43f8-a071-e7ef74839d86/router/0.log" Jun 03 15:21:55.603437 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:55.603399 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n7kqc/must-gather-6j8gq"] Jun 03 15:21:55.606851 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:55.606836 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7kqc/must-gather-6j8gq" Jun 03 15:21:55.609693 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:55.609672 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n7kqc\"/\"kube-root-ca.crt\"" Jun 03 15:21:55.610845 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:55.610823 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n7kqc\"/\"default-dockercfg-glhxv\"" Jun 03 15:21:55.610977 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:55.610954 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n7kqc\"/\"openshift-service-ca.crt\"" Jun 03 15:21:55.627481 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:55.627454 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7kqc/must-gather-6j8gq"] Jun 03 15:21:55.711934 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:55.711893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f8fed3ea-0a16-40fe-8768-cbde4d3165f0-must-gather-output\") pod \"must-gather-6j8gq\" (UID: \"f8fed3ea-0a16-40fe-8768-cbde4d3165f0\") " pod="openshift-must-gather-n7kqc/must-gather-6j8gq" Jun 03 15:21:55.712100 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:55.711939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xghz\" (UniqueName: \"kubernetes.io/projected/f8fed3ea-0a16-40fe-8768-cbde4d3165f0-kube-api-access-7xghz\") pod \"must-gather-6j8gq\" (UID: \"f8fed3ea-0a16-40fe-8768-cbde4d3165f0\") " pod="openshift-must-gather-n7kqc/must-gather-6j8gq" Jun 03 15:21:55.813136 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:55.813095 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f8fed3ea-0a16-40fe-8768-cbde4d3165f0-must-gather-output\") pod \"must-gather-6j8gq\" (UID: \"f8fed3ea-0a16-40fe-8768-cbde4d3165f0\") " pod="openshift-must-gather-n7kqc/must-gather-6j8gq" Jun 03 15:21:55.813136 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:55.813136 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xghz\" (UniqueName: \"kubernetes.io/projected/f8fed3ea-0a16-40fe-8768-cbde4d3165f0-kube-api-access-7xghz\") pod \"must-gather-6j8gq\" (UID: \"f8fed3ea-0a16-40fe-8768-cbde4d3165f0\") " pod="openshift-must-gather-n7kqc/must-gather-6j8gq" Jun 03 15:21:55.813517 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:55.813494 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f8fed3ea-0a16-40fe-8768-cbde4d3165f0-must-gather-output\") pod \"must-gather-6j8gq\" (UID: \"f8fed3ea-0a16-40fe-8768-cbde4d3165f0\") " pod="openshift-must-gather-n7kqc/must-gather-6j8gq" Jun 03 15:21:55.821676 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:55.821653 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xghz\" (UniqueName: \"kubernetes.io/projected/f8fed3ea-0a16-40fe-8768-cbde4d3165f0-kube-api-access-7xghz\") pod \"must-gather-6j8gq\" (UID: \"f8fed3ea-0a16-40fe-8768-cbde4d3165f0\") " pod="openshift-must-gather-n7kqc/must-gather-6j8gq" Jun 03 15:21:55.915835 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:55.915736 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7kqc/must-gather-6j8gq" Jun 03 15:21:56.068041 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:56.068004 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7kqc/must-gather-6j8gq"] Jun 03 15:21:56.071133 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:21:56.071096 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8fed3ea_0a16_40fe_8768_cbde4d3165f0.slice/crio-2eeb6ebc31236156575c1189284a41028b605c802cd60f43d62e9c02e24f0a45 WatchSource:0}: Error finding container 2eeb6ebc31236156575c1189284a41028b605c802cd60f43d62e9c02e24f0a45: Status 404 returned error can't find the container with id 2eeb6ebc31236156575c1189284a41028b605c802cd60f43d62e9c02e24f0a45 Jun 03 15:21:56.072935 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:56.072919 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:21:56.449292 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:56.449255 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7kqc/must-gather-6j8gq" event={"ID":"f8fed3ea-0a16-40fe-8768-cbde4d3165f0","Type":"ContainerStarted","Data":"2eeb6ebc31236156575c1189284a41028b605c802cd60f43d62e9c02e24f0a45"} Jun 03 15:21:57.455967 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:57.455925 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7kqc/must-gather-6j8gq" event={"ID":"f8fed3ea-0a16-40fe-8768-cbde4d3165f0","Type":"ContainerStarted","Data":"4d90ed02235820a8d672ab98d7ecbc4f64f42f882fe582755d5f292925ee5b4e"} Jun 03 15:21:57.456339 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:57.455975 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7kqc/must-gather-6j8gq" event={"ID":"f8fed3ea-0a16-40fe-8768-cbde4d3165f0","Type":"ContainerStarted","Data":"119ea2b5612488d749aecc3418ee4e4262b4dc66f5ebbcfc7bb3b6db18a4e9b7"} Jun 03 15:21:57.474952 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:57.474890 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-n7kqc/must-gather-6j8gq" podStartSLOduration=1.6470399310000001 podStartE2EDuration="2.47487175s" podCreationTimestamp="2026-06-03 15:21:55 +0000 UTC" firstStartedPulling="2026-06-03 15:21:56.073046231 +0000 UTC m=+1143.426016236" lastFinishedPulling="2026-06-03 15:21:56.900878046 +0000 UTC m=+1144.253848055" observedRunningTime="2026-06-03 15:21:57.472837812 +0000 UTC m=+1144.825807872" watchObservedRunningTime="2026-06-03 15:21:57.47487175 +0000 UTC m=+1144.827841778" Jun 03 15:21:58.676795 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:58.676760 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d6kcq_4a0def35-868d-4101-9dc2-c4f9f817ac49/global-pull-secret-syncer/0.log" Jun 03 15:21:58.903565 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:58.903530 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t8c26_405bb2f8-ad71-471c-911b-eb4b83fbeca3/konnectivity-agent/0.log" Jun 03 15:21:58.924065 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:21:58.924037 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-78.ec2.internal_9b24b2754441fa0c9003b6647a9dd2f7/haproxy/0.log" Jun 03 15:22:03.741191 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:03.741158 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-pp97q_03089744-c8b1-4132-b429-601f8c753c6d/manager/0.log" Jun 03 15:22:05.366233 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:05.366188 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-88whh_399fce46-fa37-43a7-b31e-0e5848d3735e/cluster-monitoring-operator/0.log" Jun 03 15:22:05.582857 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:05.582784 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kwcfx_e8af208a-fc42-4fcd-86a8-07b0dc6182ad/node-exporter/0.log" Jun 03 15:22:05.605185 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:05.605155 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kwcfx_e8af208a-fc42-4fcd-86a8-07b0dc6182ad/kube-rbac-proxy/0.log" Jun 03 15:22:05.628832 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:05.628797 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kwcfx_e8af208a-fc42-4fcd-86a8-07b0dc6182ad/init-textfile/0.log" Jun 03 15:22:06.114095 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:06.114002 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-9js9r_8f687314-29b5-4b7a-8db5-f86fb4033be0/prometheus-operator/0.log" Jun 03 15:22:06.134443 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:06.134414 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-9js9r_8f687314-29b5-4b7a-8db5-f86fb4033be0/kube-rbac-proxy/0.log" Jun 03 15:22:06.158869 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:06.158839 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-z6jjd_bd2d02c5-5aac-4af9-84af-6064147e26d6/prometheus-operator-admission-webhook/0.log" Jun 03 15:22:07.509974 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:07.509946 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-fdjbh_3a300de4-981a-4bee-8f25-c25a10a85d29/networking-console-plugin/0.log" Jun 03 15:22:08.076237 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.076203 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hskk5_05144d0b-dd83-4d3c-9b43-4480b3fc8a35/console-operator/1.log" Jun 03 15:22:08.077413 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.077386 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl"] Jun 03 15:22:08.084865 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.084836 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:08.085955 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.085932 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hskk5_05144d0b-dd83-4d3c-9b43-4480b3fc8a35/console-operator/2.log" Jun 03 15:22:08.092675 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.092651 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl"] Jun 03 15:22:08.165835 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.165794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f90c5fe4-ae61-4809-a616-b14a766f3f3c-lib-modules\") pod \"perf-node-gather-daemonset-49bxl\" (UID: \"f90c5fe4-ae61-4809-a616-b14a766f3f3c\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:08.166014 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.165856 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f90c5fe4-ae61-4809-a616-b14a766f3f3c-podres\") pod \"perf-node-gather-daemonset-49bxl\" (UID: \"f90c5fe4-ae61-4809-a616-b14a766f3f3c\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:08.166014 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.165888 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f90c5fe4-ae61-4809-a616-b14a766f3f3c-sys\") pod \"perf-node-gather-daemonset-49bxl\" (UID: \"f90c5fe4-ae61-4809-a616-b14a766f3f3c\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:08.166014 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.165913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnnsk\" (UniqueName: \"kubernetes.io/projected/f90c5fe4-ae61-4809-a616-b14a766f3f3c-kube-api-access-lnnsk\") pod \"perf-node-gather-daemonset-49bxl\" (UID: \"f90c5fe4-ae61-4809-a616-b14a766f3f3c\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:08.166014 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.165990 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f90c5fe4-ae61-4809-a616-b14a766f3f3c-proc\") pod \"perf-node-gather-daemonset-49bxl\" (UID: \"f90c5fe4-ae61-4809-a616-b14a766f3f3c\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:08.266996 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.266957 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f90c5fe4-ae61-4809-a616-b14a766f3f3c-lib-modules\") pod \"perf-node-gather-daemonset-49bxl\" (UID: \"f90c5fe4-ae61-4809-a616-b14a766f3f3c\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:08.266996 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.267006 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f90c5fe4-ae61-4809-a616-b14a766f3f3c-podres\") pod \"perf-node-gather-daemonset-49bxl\" (UID: \"f90c5fe4-ae61-4809-a616-b14a766f3f3c\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:08.267227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.267028 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f90c5fe4-ae61-4809-a616-b14a766f3f3c-sys\") pod \"perf-node-gather-daemonset-49bxl\" (UID: \"f90c5fe4-ae61-4809-a616-b14a766f3f3c\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:08.267227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.267064 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lnnsk\" (UniqueName: \"kubernetes.io/projected/f90c5fe4-ae61-4809-a616-b14a766f3f3c-kube-api-access-lnnsk\") pod \"perf-node-gather-daemonset-49bxl\" (UID: \"f90c5fe4-ae61-4809-a616-b14a766f3f3c\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:08.267227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.267138 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f90c5fe4-ae61-4809-a616-b14a766f3f3c-proc\") pod \"perf-node-gather-daemonset-49bxl\" (UID: \"f90c5fe4-ae61-4809-a616-b14a766f3f3c\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:08.267227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.267151 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f90c5fe4-ae61-4809-a616-b14a766f3f3c-podres\") pod \"perf-node-gather-daemonset-49bxl\" (UID: \"f90c5fe4-ae61-4809-a616-b14a766f3f3c\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:08.267227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.267158 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f90c5fe4-ae61-4809-a616-b14a766f3f3c-sys\") pod \"perf-node-gather-daemonset-49bxl\" (UID: \"f90c5fe4-ae61-4809-a616-b14a766f3f3c\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:08.267227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.267213 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f90c5fe4-ae61-4809-a616-b14a766f3f3c-proc\") pod \"perf-node-gather-daemonset-49bxl\" (UID: \"f90c5fe4-ae61-4809-a616-b14a766f3f3c\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:08.267227 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.267158 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f90c5fe4-ae61-4809-a616-b14a766f3f3c-lib-modules\") pod \"perf-node-gather-daemonset-49bxl\" (UID: \"f90c5fe4-ae61-4809-a616-b14a766f3f3c\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:08.275230 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.275199 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnnsk\" (UniqueName: \"kubernetes.io/projected/f90c5fe4-ae61-4809-a616-b14a766f3f3c-kube-api-access-lnnsk\") pod \"perf-node-gather-daemonset-49bxl\" (UID: \"f90c5fe4-ae61-4809-a616-b14a766f3f3c\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:08.398035 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.398004 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:08.583804 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.583772 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl"] Jun 03 15:22:08.584326 ip-10-0-130-78 kubenswrapper[2577]: W0603 15:22:08.584272 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf90c5fe4_ae61_4809_a616_b14a766f3f3c.slice/crio-920ac343e5762e3cca1b62e66a4b4e37183f7005382a9ddabb90433b62a76915 WatchSource:0}: Error finding container 920ac343e5762e3cca1b62e66a4b4e37183f7005382a9ddabb90433b62a76915: Status 404 returned error can't find the container with id 920ac343e5762e3cca1b62e66a4b4e37183f7005382a9ddabb90433b62a76915 Jun 03 15:22:08.681968 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.681899 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-584846b987-l267v_c9626509-656a-4962-927c-7edeb67d4f3a/console/0.log" Jun 03 15:22:08.737846 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:08.737812 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-7d9x6_b1623a8b-9473-4fe6-996e-864cd730ddfa/download-server/0.log" Jun 03 15:22:09.252263 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:09.252235 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-tmjbd_2cf31970-1119-4806-b4e0-0e26a630594a/volume-data-source-validator/0.log" Jun 03 15:22:09.532768 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:09.532651 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" event={"ID":"f90c5fe4-ae61-4809-a616-b14a766f3f3c","Type":"ContainerStarted","Data":"bd733741a977f3fd917387bf442d1c6d945630d9bffa310c7baccd87042fc1c1"} Jun 03 15:22:09.532768 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:09.532687 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" event={"ID":"f90c5fe4-ae61-4809-a616-b14a766f3f3c","Type":"ContainerStarted","Data":"920ac343e5762e3cca1b62e66a4b4e37183f7005382a9ddabb90433b62a76915"} Jun 03 15:22:09.532989 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:09.532803 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:09.554474 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:09.554418 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" podStartSLOduration=1.554400351 podStartE2EDuration="1.554400351s" podCreationTimestamp="2026-06-03 15:22:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:22:09.551439857 +0000 UTC m=+1156.904409884" watchObservedRunningTime="2026-06-03 15:22:09.554400351 +0000 UTC m=+1156.907370378" Jun 03 15:22:10.079555 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:10.079522 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gbhfn_466be55f-b28b-4b72-979e-b679d95de62c/dns/0.log" Jun 03 15:22:10.103008 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:10.102983 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gbhfn_466be55f-b28b-4b72-979e-b679d95de62c/kube-rbac-proxy/0.log" Jun 03 15:22:10.174981 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:10.174955 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4b7cx_00ed60d1-2492-44e1-864a-5028e232bb54/dns-node-resolver/0.log" Jun 03 15:22:10.820000 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:10.819968 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mfll7_c8756071-49e9-431b-86a8-d179d071de13/node-ca/0.log" Jun 03 15:22:11.783850 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:11.783819 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b6fs6d_1a0e8bea-3b2e-4f74-8efe-f831da6478b9/istio-proxy/0.log" Jun 03 15:22:11.970342 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:11.970310 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-rpd8h_9a78db9b-c9ad-47a2-b262-82ae9a6e9ed3/istio-proxy/0.log" Jun 03 15:22:12.028409 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:12.028377 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64cd489db9-fdf9z_c6b8dc06-9393-43f8-a071-e7ef74839d86/router/0.log" Jun 03 15:22:12.669429 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:12.669399 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wp7ml_747b2535-7bfc-402d-ab7c-b645e8c06569/serve-healthcheck-canary/0.log" Jun 03 15:22:13.124724 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:13.124693 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-lkk8x_1536eb21-7935-4dc8-8066-9e6d7e6c3ab5/insights-operator/1.log" Jun 03 15:22:13.125755 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:13.125728 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-lkk8x_1536eb21-7935-4dc8-8066-9e6d7e6c3ab5/insights-operator/0.log" Jun 03 15:22:13.291144 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:13.291103 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wrzg5_54259166-c5f7-4ebf-9f36-206473a31278/kube-rbac-proxy/0.log" Jun 03 15:22:13.313327 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:13.313279 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wrzg5_54259166-c5f7-4ebf-9f36-206473a31278/exporter/0.log" Jun 03 15:22:13.337807 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:13.337782 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wrzg5_54259166-c5f7-4ebf-9f36-206473a31278/extractor/0.log" Jun 03 15:22:15.441818 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:15.441787 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-86b6644fd4-zwskc_569410a7-77e5-4c6e-924c-0d8039a34284/nginx/0.log" Jun 03 15:22:15.546199 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:15.546171 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-49bxl" Jun 03 15:22:15.855140 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:15.855110 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5678f4b79b-xmbqt_b013a5a0-f6b8-4489-8553-505b3875e1db/manager/0.log" Jun 03 15:22:15.874023 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:15.873997 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5678f4b79b-xmbqt_b013a5a0-f6b8-4489-8553-505b3875e1db/copy-manifests/0.log" Jun 03 15:22:17.498624 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:17.498584 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f7c5db56c-w58hl_89981a83-40eb-4720-ac96-980e8841a650/manager/0.log" Jun 03 15:22:22.441723 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:22.441685 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-7dbrz_efd18cdc-0c9b-40d3-9e6c-3e249d7f63b0/migrator/0.log" Jun 03 15:22:22.460679 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:22.460651 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-7dbrz_efd18cdc-0c9b-40d3-9e6c-3e249d7f63b0/graceful-termination/0.log" Jun 03 15:22:22.910658 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:22.910622 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-vzpss_6c1d6767-775a-4feb-ab75-d42366001da8/kube-storage-version-migrator-operator/0.log" Jun 03 15:22:22.912622 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:22.912598 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-vzpss_6c1d6767-775a-4feb-ab75-d42366001da8/kube-storage-version-migrator-operator/1.log" Jun 03 15:22:24.386591 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:24.386550 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xm4dj_efd0c5f0-905f-486d-9f9c-f8ed997b2c9b/kube-multus-additional-cni-plugins/0.log" Jun 03 15:22:24.406277 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:24.406248 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xm4dj_efd0c5f0-905f-486d-9f9c-f8ed997b2c9b/egress-router-binary-copy/0.log" Jun 03 15:22:24.424701 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:24.424650 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xm4dj_efd0c5f0-905f-486d-9f9c-f8ed997b2c9b/cni-plugins/0.log" Jun 03 15:22:24.443928 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:24.443905 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xm4dj_efd0c5f0-905f-486d-9f9c-f8ed997b2c9b/bond-cni-plugin/0.log" Jun 03 15:22:24.465038 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:24.465010 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xm4dj_efd0c5f0-905f-486d-9f9c-f8ed997b2c9b/routeoverride-cni/0.log" Jun 03 15:22:24.483889 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:24.483863 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xm4dj_efd0c5f0-905f-486d-9f9c-f8ed997b2c9b/whereabouts-cni-bincopy/0.log" Jun 03 15:22:24.506150 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:24.506125 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xm4dj_efd0c5f0-905f-486d-9f9c-f8ed997b2c9b/whereabouts-cni/0.log" Jun 03 15:22:24.542064 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:24.542033 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qbb9d_112d4f9b-4999-4802-92a9-94d911849614/kube-multus/0.log" Jun 03 15:22:24.606738 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:24.606712 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-klxj7_80b3ece5-3176-4984-821a-d8817e635c90/network-metrics-daemon/0.log" Jun 03 15:22:24.625446 ip-10-0-130-78 kubenswrapper[2577]: I0603 15:22:24.625420 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-klxj7_80b3ece5-3176-4984-821a-d8817e635c90/kube-rbac-proxy/0.log"