Jun 14 15:51:09.849227 ip-10-0-143-112 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 14 15:51:09.849238 ip-10-0-143-112 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 14 15:51:09.849245 ip-10-0-143-112 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 14 15:51:09.849508 ip-10-0-143-112 systemd[1]: Failed to start Kubernetes Kubelet. Jun 14 15:51:19.695133 ip-10-0-143-112 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 14 15:51:19.695149 ip-10-0-143-112 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot cb03ae658cd1415da43fdc1ae1ffae12 -- Jun 14 15:53:18.939579 ip-10-0-143-112 systemd[1]: Starting Kubernetes Kubelet... Jun 14 15:53:19.388576 ip-10-0-143-112 kubenswrapper[2528]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 15:53:19.388576 ip-10-0-143-112 kubenswrapper[2528]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 15:53:19.388576 ip-10-0-143-112 kubenswrapper[2528]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 15:53:19.388576 ip-10-0-143-112 kubenswrapper[2528]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 15:53:19.388576 ip-10-0-143-112 kubenswrapper[2528]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 15:53:19.391565 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.391409 2528 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 15:53:19.396783 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396754 2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 15:53:19.396783 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396780 2528 feature_gate.go:328] unrecognized feature gate: Example Jun 14 15:53:19.396783 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396784 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 15:53:19.396783 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396787 2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396791 2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396795 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396798 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396801 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396804 2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396806 2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396811 2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396814 2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396817 2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396821 2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396825 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396836 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396839 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396842 2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396845 2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396848 2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396850 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396853 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396856 2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 15:53:19.396923 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396858 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396862 2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396864 2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396867 2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396869 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396871 2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396874 2528 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396877 2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396880 2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396883 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396885 2528 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396888 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396891 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396893 2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396897 2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396902 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396905 2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396909 2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396913 2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396916 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 15:53:19.397463 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396920 2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396923 2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396926 2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396929 2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396933 2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396935 2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396938 2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396941 2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396943 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396946 2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396949 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396951 2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396954 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396957 2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396959 2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396962 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396964 2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396967 2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396970 2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 15:53:19.397940 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396972 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396975 2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396977 2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396980 2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396983 2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396985 2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396988 2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396992 2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396994 2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.396997 2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397000 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397003 2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397006 2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397008 2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397010 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397013 2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397017 2528 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397020 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397022 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397025 2528 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 15:53:19.398418 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397027 2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397030 2528 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397033 2528 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397035 2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397038 2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397042 2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397045 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397048 2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397051 2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397054 2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397056 2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397059 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397062 2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397066 2528 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397068 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397071 2528 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397074 2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397813 2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397821 2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 15:53:19.398911 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397824 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397827 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397830 2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397835 2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397838 2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397841 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397843 2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397846 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397849 2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397851 2528 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397854 2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397856 2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397859 2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397861 2528 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397864 2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397866 2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397869 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397871 2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397874 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397877 2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 15:53:19.399413 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397880 2528 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397882 2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397885 2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397887 2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397890 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397893 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397896 2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397898 2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397901 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397903 2528 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397906 2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397909 2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397914 2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397917 2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397921 2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397925 2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397928 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397930 2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397933 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 15:53:19.399957 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397936 2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397938 2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397941 2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397944 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397948 2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397950 2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397954 2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397956 2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397959 2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397961 2528 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397964 2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397967 2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397969 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397972 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397975 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397977 2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397980 2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397982 2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397985 2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397987 2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 15:53:19.400543 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397989 2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397993 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397996 2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.397998 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398000 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398003 2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398006 2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398009 2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398011 2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398013 2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398018 2528 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398020 2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398023 2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398025 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398028 2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398030 2528 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398033 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398035 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398038 2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398041 2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 15:53:19.401056 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398043 2528 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398046 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398048 2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398051 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398053 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398056 2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398058 2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398061 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398063 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398066 2528 feature_gate.go:328] unrecognized feature gate: Example Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398069 2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398071 2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398074 2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398077 2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398081 2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398083 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398086 2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398092 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398538 2528 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398544 2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 15:53:19.401608 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398547 2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398550 2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398558 2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398561 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398564 2528 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398567 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398569 2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398572 2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398575 2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398577 2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398582 2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398585 2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398588 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398591 2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398594 2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398597 2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398600 2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398602 2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398605 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 15:53:19.402109 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398608 2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398611 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398614 2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398616 2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398619 2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398622 2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398625 2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398628 2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398630 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398633 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398638 2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398640 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398643 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398645 2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398648 2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398651 2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398660 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398663 2528 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398665 2528 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398668 2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 15:53:19.402578 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398671 2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398673 2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398676 2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398678 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398681 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398684 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398686 2528 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398689 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398691 2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398694 2528 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398696 2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398698 2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398701 2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398704 2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398706 2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398709 2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398711 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398714 2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398717 2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398721 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 15:53:19.403164 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398723 2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398726 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398730 2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398732 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398735 2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398737 2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398740 2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398742 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398745 2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398748 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398751 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398753 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398757 2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398759 2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398762 2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398764 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398766 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398771 2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398775 2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 15:53:19.403682 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398778 2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398781 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398785 2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398787 2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398790 2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398792 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398795 2528 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398797 2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398800 2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398802 2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398804 2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398808 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398811 2528 feature_gate.go:328] unrecognized feature gate: Example Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398813 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398816 2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398820 2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398822 2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398825 2528 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.398827 2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.398915 2528 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.398928 2528 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 15:53:19.404152 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.398939 2528 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.398946 2528 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.398953 2528 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.398957 2528 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.398961 2528 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.398966 2528 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.398969 2528 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.398972 2528 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.398975 2528 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.398979 2528 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.398982 2528 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.398985 2528 flags.go:64] FLAG: --cgroup-root="" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.398987 2528 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.398990 2528 flags.go:64] FLAG: --client-ca-file="" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.398993 2528 flags.go:64] FLAG: --cloud-provider="external" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.398996 2528 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399000 2528 flags.go:64] FLAG: --cluster-domain="" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399003 2528 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399007 2528 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399010 2528 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399014 2528 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399018 2528 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399021 2528 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 15:53:19.404748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399025 2528 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399028 2528 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399031 2528 flags.go:64] FLAG: --contention-profiling="false" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399035 2528 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399038 2528 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399042 2528 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399044 2528 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399049 2528 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399052 2528 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399055 2528 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399058 2528 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399061 2528 flags.go:64] FLAG: --enable-server="true" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399067 2528 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399072 2528 flags.go:64] FLAG: --event-burst="100" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399075 2528 flags.go:64] FLAG: --event-qps="50" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399078 2528 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399081 2528 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399084 2528 flags.go:64] FLAG: --eviction-hard="" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399088 2528 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399091 2528 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399093 2528 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399096 2528 flags.go:64] FLAG: --eviction-soft="" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399099 2528 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399102 2528 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399105 2528 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 15:53:19.405328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399108 2528 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399111 2528 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399115 2528 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399118 2528 flags.go:64] FLAG: --feature-gates="" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399122 2528 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399125 2528 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399128 2528 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399131 2528 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399134 2528 flags.go:64] FLAG: --healthz-port="10248" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399137 2528 flags.go:64] FLAG: --help="false" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399141 2528 flags.go:64] FLAG: --hostname-override="ip-10-0-143-112.ec2.internal" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399144 2528 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399147 2528 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399150 2528 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399153 2528 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399156 2528 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399159 2528 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399162 2528 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399165 2528 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399167 2528 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399171 2528 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399174 2528 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399177 2528 flags.go:64] FLAG: --kube-reserved="" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399180 2528 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 15:53:19.405985 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399183 2528 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399186 2528 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399188 2528 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399191 2528 flags.go:64] FLAG: --lock-file="" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399194 2528 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399197 2528 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399200 2528 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399205 2528 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399208 2528 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399223 2528 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399226 2528 flags.go:64] FLAG: --logging-format="text" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399230 2528 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399233 2528 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399236 2528 flags.go:64] FLAG: --manifest-url="" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399239 2528 flags.go:64] FLAG: --manifest-url-header="" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399244 2528 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399247 2528 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399250 2528 flags.go:64] FLAG: --max-pods="110" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399255 2528 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399258 2528 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399260 2528 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399263 2528 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399266 2528 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399269 2528 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399272 2528 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 15:53:19.406585 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399279 2528 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399282 2528 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399285 2528 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399288 2528 flags.go:64] FLAG: --pod-cidr="" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399292 2528 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399298 2528 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399301 2528 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399304 2528 flags.go:64] FLAG: --pods-per-core="0" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399307 2528 flags.go:64] FLAG: --port="10250" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399310 2528 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399313 2528 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0563a5ed4b1ce1491" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399316 2528 flags.go:64] FLAG: --qos-reserved="" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399319 2528 flags.go:64] FLAG: --read-only-port="10255" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399322 2528 flags.go:64] FLAG: --register-node="true" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399325 2528 flags.go:64] FLAG: --register-with-taints="" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399328 2528 flags.go:64] FLAG: --registry-burst="10" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399331 2528 flags.go:64] FLAG: --registry-qps="5" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399336 2528 flags.go:64] FLAG: --reserved-cpus="" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399339 2528 flags.go:64] FLAG: --reserved-memory="" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399343 2528 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399346 2528 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399349 2528 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399352 2528 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399355 2528 flags.go:64] FLAG: --runonce="false" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399357 2528 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 15:53:19.407201 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399360 2528 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399365 2528 flags.go:64] FLAG: --seccomp-default="false" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399368 2528 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399371 2528 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399374 2528 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399377 2528 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399381 2528 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399383 2528 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399386 2528 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399390 2528 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399392 2528 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399395 2528 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399399 2528 flags.go:64] FLAG: --system-cgroups="" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399402 2528 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399407 2528 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399410 2528 flags.go:64] FLAG: --tls-cert-file="" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399413 2528 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399418 2528 flags.go:64] FLAG: --tls-min-version="" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399420 2528 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399423 2528 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399426 2528 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399429 2528 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399432 2528 flags.go:64] FLAG: --v="2" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399436 2528 flags.go:64] FLAG: --version="false" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399443 2528 flags.go:64] FLAG: --vmodule="" Jun 14 15:53:19.407866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399446 2528 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.399449 2528 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399594 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399598 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399601 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399603 2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399606 2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399609 2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399631 2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399633 2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399636 2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399639 2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399641 2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399644 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399648 2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399652 2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399654 2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399657 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399659 2528 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399662 2528 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 15:53:19.408517 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399665 2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399668 2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399670 2528 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399673 2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399675 2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399678 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399680 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399683 2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399686 2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399689 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399691 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399696 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399698 2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399701 2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399703 2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399706 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399708 2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399710 2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399713 2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 15:53:19.409020 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399716 2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399719 2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399722 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399726 2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399730 2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399733 2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399737 2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399740 2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399743 2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399745 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399748 2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399751 2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399753 2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399756 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399759 2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399761 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399764 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399767 2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399769 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 15:53:19.409557 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399772 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399774 2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399777 2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399780 2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399782 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399786 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399789 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399791 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399794 2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399796 2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399799 2528 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399801 2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399804 2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399807 2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399811 2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399814 2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399816 2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399819 2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399821 2528 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399824 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 15:53:19.410015 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399826 2528 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399829 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399831 2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399834 2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399836 2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399839 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399842 2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399844 2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399854 2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399857 2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399860 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399862 2528 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399864 2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399867 2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399869 2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399872 2528 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399874 2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399878 2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399881 2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399883 2528 feature_gate.go:328] unrecognized feature gate: Example Jun 14 15:53:19.410511 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399886 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 15:53:19.411001 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399888 2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 15:53:19.411001 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.399891 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 15:53:19.411001 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.400848 2528 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 15:53:19.411001 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.408757 2528 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 15:53:19.411001 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.408781 2528 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 15:53:19.411001 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.408804 2528 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 15:53:19.411001 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.408811 2528 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 15:53:19.411001 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408871 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 15:53:19.411001 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408876 2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 15:53:19.411001 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408879 2528 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 15:53:19.411001 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408882 2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 15:53:19.411001 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408885 2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 15:53:19.411001 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408888 2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 15:53:19.411001 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408891 2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 15:53:19.411001 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408895 2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408898 2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408900 2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408903 2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408906 2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408910 2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408912 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408915 2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408917 2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408920 2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408922 2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408925 2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408928 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408930 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408933 2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408935 2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408938 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408940 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408943 2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408947 2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 15:53:19.411396 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408951 2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408954 2528 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408958 2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408960 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408963 2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408966 2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408969 2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408971 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408973 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408976 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408979 2528 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408981 2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408984 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408986 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408989 2528 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408991 2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408994 2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408996 2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.408999 2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409001 2528 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 15:53:19.411890 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409004 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409006 2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409009 2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409011 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409014 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409016 2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409019 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409022 2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409024 2528 feature_gate.go:328] unrecognized feature gate: Example Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409028 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409030 2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409033 2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409036 2528 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409039 2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409042 2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409045 2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409048 2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409050 2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409053 2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409055 2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 15:53:19.412560 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409058 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409060 2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409062 2528 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409065 2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409067 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409069 2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409072 2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409074 2528 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409077 2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409079 2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409081 2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409084 2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409086 2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409089 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409092 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409094 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409097 2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409099 2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409102 2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409105 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 15:53:19.413089 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409108 2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 15:53:19.413602 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409111 2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 15:53:19.413602 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409113 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 15:53:19.413602 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409116 2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 15:53:19.413602 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409118 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 15:53:19.413602 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409122 2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 15:53:19.413602 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409126 2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 15:53:19.413602 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409130 2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 15:53:19.413602 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409133 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 15:53:19.413602 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409136 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 15:53:19.413602 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409139 2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 15:53:19.413602 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409142 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 15:53:19.413602 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.409147 2528 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 15:53:19.413602 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409292 2528 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 15:53:19.413602 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409298 2528 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409301 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409304 2528 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409308 2528 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409311 2528 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409315 2528 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409318 2528 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409321 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409323 2528 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409326 2528 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409330 2528 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409333 2528 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409335 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409338 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409341 2528 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409343 2528 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409346 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409349 2528 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409351 2528 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 15:53:19.413969 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409354 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409357 2528 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409359 2528 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409362 2528 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409365 2528 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409367 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409370 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409372 2528 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409375 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409377 2528 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409380 2528 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409382 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409385 2528 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409388 2528 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409390 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409393 2528 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409395 2528 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409398 2528 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409400 2528 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 15:53:19.414447 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409403 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409406 2528 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409409 2528 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409412 2528 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409414 2528 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409418 2528 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409420 2528 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409422 2528 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409425 2528 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409427 2528 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409430 2528 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409433 2528 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409435 2528 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409438 2528 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409440 2528 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409443 2528 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409445 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409448 2528 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409450 2528 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409453 2528 feature_gate.go:328] unrecognized feature gate: Example Jun 14 15:53:19.414916 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409455 2528 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409458 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409461 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409463 2528 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409466 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409468 2528 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409470 2528 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409473 2528 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409475 2528 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409478 2528 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409480 2528 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409482 2528 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409485 2528 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409487 2528 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409490 2528 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409492 2528 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409494 2528 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409497 2528 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409500 2528 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409502 2528 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 15:53:19.415458 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409504 2528 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409507 2528 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409509 2528 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409512 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409514 2528 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409518 2528 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409521 2528 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409524 2528 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409527 2528 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409530 2528 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409533 2528 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409536 2528 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409539 2528 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409542 2528 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409545 2528 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409547 2528 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409550 2528 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409552 2528 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409554 2528 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 15:53:19.415931 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:19.409557 2528 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 15:53:19.416466 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.409562 2528 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 15:53:19.416466 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.409715 2528 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 15:53:19.416466 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.412184 2528 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 15:53:19.416466 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.413987 2528 server.go:1019] "Starting client certificate rotation" Jun 14 15:53:19.416466 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.414098 2528 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 15:53:19.416466 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.414136 2528 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 15:53:19.420935 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.420880 2528 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 15:53:19.423151 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.423125 2528 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 15:53:19.436686 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.436658 2528 log.go:25] "Validated CRI v1 runtime API" Jun 14 15:53:19.440847 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.440828 2528 log.go:25] "Validated CRI v1 image API" Jun 14 15:53:19.441880 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.441864 2528 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 15:53:19.444936 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.444912 2528 fs.go:135] Filesystem UUIDs: map[3d8ffc54-cb23-48ff-8c68-409090779a19:/dev/nvme0n1p3 63820615-9a6c-4807-81b9-c2cecd5aa8f1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 14 15:53:19.445019 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.444935 2528 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 15:53:19.449631 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.449497 2528 manager.go:216] Machine: {Timestamp:2026-06-14 15:53:19.448969101 +0000 UTC m=+0.378616787 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106015 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f0141d5ddcbb6d8d83262d4a1f892 SystemUUID:ec2f0141-d5dd-cbb6-d8d8-3262d4a1f892 BootID:cb03ae65-8cd1-415d-a43f-dc1ae1ffae12 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:26:1a:c0:7c:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:26:1a:c0:7c:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:de:6b:ef:e5:fd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 15:53:19.449631 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.449616 2528 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 15:53:19.449781 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.449757 2528 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 15:53:19.451670 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.451651 2528 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 15:53:19.453418 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.453386 2528 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 15:53:19.453577 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.453425 2528 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-112.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 15:53:19.454336 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.454324 2528 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 15:53:19.454375 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.454339 2528 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 15:53:19.454375 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.454347 2528 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 15:53:19.454375 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.454358 2528 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 15:53:19.455646 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.455635 2528 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 15:53:19.460940 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.460920 2528 state_mem.go:36] "Initialized new in-memory state store" Jun 14 15:53:19.461100 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.461090 2528 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 15:53:19.461135 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.461127 2528 kubelet.go:486] "Attempting to sync node with API server" Jun 14 15:53:19.461166 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.461138 2528 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 15:53:19.461166 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.461154 2528 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 15:53:19.461166 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.461165 2528 kubelet.go:398] "Adding apiserver pod source" Jun 14 15:53:19.461274 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.461175 2528 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 15:53:19.461705 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.461688 2528 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 15:53:19.461751 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.461722 2528 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 15:53:19.472090 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.472058 2528 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 15:53:19.473859 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.473845 2528 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 15:53:19.473927 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.473876 2528 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 15:53:19.474065 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:19.474046 2528 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-112.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 15:53:19.474132 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:19.474109 2528 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 15:53:19.475308 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.475295 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 15:53:19.475362 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.475313 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 15:53:19.475362 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.475320 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 15:53:19.475362 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.475326 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 15:53:19.475362 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.475335 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 15:53:19.475362 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.475341 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 15:53:19.475362 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.475349 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 15:53:19.475362 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.475355 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 15:53:19.475362 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.475362 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 15:53:19.475572 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.475368 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 15:53:19.475572 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.475376 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 15:53:19.475572 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.475383 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 15:53:19.476255 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.476246 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 15:53:19.476255 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.476255 2528 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 15:53:19.479678 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.479508 2528 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-112.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 15:53:19.479678 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.479658 2528 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 15:53:19.479840 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.479611 2528 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 15:53:19.479840 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.479778 2528 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 15:53:19.479840 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.479580 2528 server.go:1268] "Started kubelet" Jun 14 15:53:19.480945 ip-10-0-143-112 systemd[1]: Started Kubernetes Kubelet. Jun 14 15:53:19.481911 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.481787 2528 server.go:310] "Adding debug handlers to kubelet server" Jun 14 15:53:19.484455 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.484434 2528 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 15:53:19.489234 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:19.489145 2528 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 15:53:19.489342 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:19.488132 2528 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-112.ec2.internal.18b8fd84cf3ef207 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-112.ec2.internal,UID:ip-10-0-143-112.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-112.ec2.internal,},FirstTimestamp:2026-06-14 15:53:19.479550471 +0000 UTC m=+0.409198160,LastTimestamp:2026-06-14 15:53:19.479550471 +0000 UTC m=+0.409198160,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-112.ec2.internal,}" Jun 14 15:53:19.490387 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.490369 2528 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 15:53:19.490387 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.490376 2528 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 15:53:19.490503 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:19.490439 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 14 15:53:19.491129 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.491107 2528 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 15:53:19.491254 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.491133 2528 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 15:53:19.491254 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.491108 2528 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 15:53:19.491353 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.491279 2528 reconstruct.go:97] "Volume reconstruction finished" Jun 14 15:53:19.491353 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.491288 2528 reconciler.go:29] "Reconciler: start to sync state" Jun 14 15:53:19.491525 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.491511 2528 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 15:53:19.491582 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.491529 2528 factory.go:55] Registering systemd factory Jun 14 15:53:19.491582 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.491539 2528 factory.go:223] Registration of the systemd container factory successfully Jun 14 15:53:19.491820 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.491796 2528 factory.go:153] Registering CRI-O factory Jun 14 15:53:19.491820 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.491814 2528 factory.go:223] Registration of the crio container factory successfully Jun 14 15:53:19.491921 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.491867 2528 factory.go:103] Registering Raw factory Jun 14 15:53:19.491921 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:19.491874 2528 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 14 15:53:19.491921 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.491883 2528 manager.go:1196] Started watching for new ooms in manager Jun 14 15:53:19.491921 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:19.491893 2528 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-112.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 14 15:53:19.492344 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.492330 2528 manager.go:349] Starting recovery of all containers Jun 14 15:53:19.497459 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.497426 2528 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s665z" Jun 14 15:53:19.504074 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.504044 2528 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s665z" Jun 14 15:53:19.507422 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.507406 2528 manager.go:354] Recovery completed Jun 14 15:53:19.511589 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.511569 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:53:19.513732 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.513708 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:53:19.513821 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.513743 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:53:19.513821 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.513753 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:53:19.514361 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.514342 2528 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 15:53:19.514361 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.514359 2528 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 15:53:19.514501 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.514390 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:53:19.514501 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.514435 2528 state_mem.go:36] "Initialized new in-memory state store" Jun 14 15:53:19.515275 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.515257 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:53:19.515327 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.515293 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:53:19.515327 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.515306 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:53:19.516541 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.516529 2528 policy_none.go:49] "None policy: Start" Jun 14 15:53:19.516591 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.516546 2528 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 15:53:19.516591 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.516558 2528 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 15:53:19.518625 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.518611 2528 policy_none.go:47] "Start" Jun 14 15:53:19.556995 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.556971 2528 manager.go:337] "Starting Device Plugin manager" Jun 14 15:53:19.572703 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:19.557011 2528 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 15:53:19.572703 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.557026 2528 server.go:87] "Starting device plugin registration server" Jun 14 15:53:19.572703 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.557368 2528 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 15:53:19.572703 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.557383 2528 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 15:53:19.572703 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.557473 2528 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 15:53:19.572703 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.557555 2528 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 15:53:19.572703 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.557564 2528 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 15:53:19.572703 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:19.558715 2528 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 15:53:19.572703 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:19.558769 2528 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-112.ec2.internal\" not found" Jun 14 15:53:19.572703 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.564021 2528 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 15:53:19.572703 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.565649 2528 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 15:53:19.572703 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.565692 2528 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 15:53:19.572703 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.565717 2528 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 15:53:19.572703 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:19.565757 2528 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 15:53:19.572703 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.568050 2528 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 15:53:19.657502 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.657466 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:53:19.658550 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.658530 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:53:19.658682 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.658567 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:53:19.658682 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.658584 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:53:19.658682 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.658613 2528 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-112.ec2.internal" Jun 14 15:53:19.666465 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.666430 2528 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal"] Jun 14 15:53:19.666569 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.666514 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:53:19.668337 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.668315 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:53:19.668486 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.668357 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:53:19.668486 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.668371 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:53:19.668486 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.668401 2528 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-112.ec2.internal" Jun 14 15:53:19.668486 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:19.668428 2528 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-112.ec2.internal\": node \"ip-10-0-143-112.ec2.internal\" not found" Jun 14 15:53:19.670799 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.670782 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:53:19.670939 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.670924 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" Jun 14 15:53:19.671004 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.670963 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:53:19.671799 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.671781 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:53:19.671883 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.671812 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:53:19.671883 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.671822 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:53:19.671883 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.671781 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:53:19.671990 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.671892 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:53:19.671990 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.671919 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:53:19.674424 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.674407 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal" Jun 14 15:53:19.674507 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.674441 2528 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 15:53:19.675540 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.675521 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientMemory" Jun 14 15:53:19.675623 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.675555 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 15:53:19.675623 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.675565 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeHasSufficientPID" Jun 14 15:53:19.692697 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.692658 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea196915da4e135b9afcd0fb87c4a58d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal\" (UID: \"ea196915da4e135b9afcd0fb87c4a58d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" Jun 14 15:53:19.692697 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.692699 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8e3889a791d0c7f22f6182a8170d3ff-config\") pod \"kube-apiserver-proxy-ip-10-0-143-112.ec2.internal\" (UID: \"c8e3889a791d0c7f22f6182a8170d3ff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal" Jun 14 15:53:19.692901 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.692725 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ea196915da4e135b9afcd0fb87c4a58d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal\" (UID: \"ea196915da4e135b9afcd0fb87c4a58d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" Jun 14 15:53:19.697566 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:19.697543 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 14 15:53:19.705260 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:19.705231 2528 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-112.ec2.internal\" not found" node="ip-10-0-143-112.ec2.internal" Jun 14 15:53:19.710270 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:19.710248 2528 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-112.ec2.internal\" not found" node="ip-10-0-143-112.ec2.internal" Jun 14 15:53:19.793141 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.793058 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ea196915da4e135b9afcd0fb87c4a58d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal\" (UID: \"ea196915da4e135b9afcd0fb87c4a58d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" Jun 14 15:53:19.793141 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.793093 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea196915da4e135b9afcd0fb87c4a58d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal\" (UID: \"ea196915da4e135b9afcd0fb87c4a58d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" Jun 14 15:53:19.793141 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.793122 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8e3889a791d0c7f22f6182a8170d3ff-config\") pod \"kube-apiserver-proxy-ip-10-0-143-112.ec2.internal\" (UID: \"c8e3889a791d0c7f22f6182a8170d3ff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal" Jun 14 15:53:19.793357 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.793156 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ea196915da4e135b9afcd0fb87c4a58d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal\" (UID: \"ea196915da4e135b9afcd0fb87c4a58d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" Jun 14 15:53:19.793357 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.793156 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8e3889a791d0c7f22f6182a8170d3ff-config\") pod \"kube-apiserver-proxy-ip-10-0-143-112.ec2.internal\" (UID: \"c8e3889a791d0c7f22f6182a8170d3ff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal" Jun 14 15:53:19.793357 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:19.793188 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea196915da4e135b9afcd0fb87c4a58d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal\" (UID: \"ea196915da4e135b9afcd0fb87c4a58d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" Jun 14 15:53:19.798206 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:19.798173 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 14 15:53:19.898732 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:19.898680 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 14 15:53:19.999584 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:19.999556 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 14 15:53:20.008768 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:20.008725 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" Jun 14 15:53:20.014109 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:20.014081 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal" Jun 14 15:53:20.100386 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:20.100288 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 14 15:53:20.200849 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:20.200814 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 14 15:53:20.301467 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:20.301426 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 14 15:53:20.402204 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:20.402170 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 14 15:53:20.413378 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:20.413345 2528 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 15:53:20.413540 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:20.413514 2528 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 15:53:20.503137 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:20.503103 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 14 15:53:20.510303 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:20.510260 2528 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 15:48:19 +0000 UTC" deadline="2027-11-22 06:46:34.774638279 +0000 UTC" Jun 14 15:53:20.510303 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:20.510295 2528 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12614h53m14.264346511s" Jun 14 15:53:20.580941 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:20.580876 2528 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 15:53:20.581491 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:20.581473 2528 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 15:53:20.603684 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:20.603646 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 14 15:53:20.704323 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:20.704242 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 14 15:53:20.714457 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:20.714429 2528 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 15:53:20.805368 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:20.805338 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 14 15:53:20.905865 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:20.905831 2528 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-112.ec2.internal\" not found" Jun 14 15:53:20.914144 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:20.914114 2528 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 15:53:20.991101 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:20.991013 2528 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" Jun 14 15:53:21.005354 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.005320 2528 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 15:53:21.006642 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.006618 2528 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal" Jun 14 15:53:21.014854 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.014814 2528 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 15:53:21.393821 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.393784 2528 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 15:53:21.462961 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.462914 2528 apiserver.go:52] "Watching apiserver" Jun 14 15:53:21.470043 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.470013 2528 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 15:53:21.471551 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.471512 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-x29bp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal","openshift-multus/multus-dl45m","openshift-ovn-kubernetes/ovnkube-node-mqv4x","kube-system/konnectivity-agent-6jp7n","kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492","openshift-cluster-node-tuning-operator/tuned-bwnfq","openshift-multus/multus-additional-cni-plugins-rbxp5","openshift-multus/network-metrics-daemon-t5kjf","openshift-network-diagnostics/network-check-target-frgn2","openshift-network-operator/iptables-alerter-snhpz","kube-system/global-pull-secret-syncer-w9q49","openshift-dns/node-resolver-tv4zb"] Jun 14 15:53:21.474472 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.474441 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.476960 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.476695 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 15:53:21.476960 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.476710 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 15:53:21.476960 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.476710 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4dtfs\"" Jun 14 15:53:21.476960 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.476878 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 15:53:21.477278 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.476999 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:21.477278 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:21.477072 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9q49" podUID="07df90f6-3e95-433f-bce9-29fb97c0fb35" Jun 14 15:53:21.479442 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.479422 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.481403 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.481379 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 15:53:21.481403 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.481385 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 15:53:21.481618 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.481598 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 15:53:21.481680 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.481621 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 15:53:21.481847 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.481830 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-b5p5k\"" Jun 14 15:53:21.481938 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.481921 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.483998 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.483977 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 15:53:21.483998 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.483990 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 15:53:21.484256 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.484241 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 15:53:21.484344 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.484327 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vvs58\"" Jun 14 15:53:21.484440 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.484425 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 15:53:21.484552 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.484537 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 15:53:21.484709 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.484695 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 15:53:21.484881 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.484866 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6jp7n" Jun 14 15:53:21.486709 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.486688 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 15:53:21.486831 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.486779 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 15:53:21.487173 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.487144 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sjlrj\"" Jun 14 15:53:21.488486 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.488457 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tv4zb" Jun 14 15:53:21.490702 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.490682 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2r265\"" Jun 14 15:53:21.490856 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.490845 2528 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 15:53:21.491567 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.491296 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.491567 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.491391 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 15:53:21.491718 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.491624 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 15:53:21.493407 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.493386 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-668rp\"" Jun 14 15:53:21.493681 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.493662 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 15:53:21.493752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.493679 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 15:53:21.496238 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.496202 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x29bp" Jun 14 15:53:21.498262 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.498241 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 15:53:21.498532 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.498243 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 15:53:21.498637 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.498260 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 15:53:21.498694 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.498317 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zpqhm\"" Jun 14 15:53:21.498908 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.498892 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.500838 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.500660 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 15:53:21.501003 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.500985 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 15:53:21.501158 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.501013 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qt5lt\"" Jun 14 15:53:21.501514 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.501493 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:21.501600 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:21.501573 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5kjf" podUID="36c343bd-9776-45d6-9fd4-6994edafd550" Jun 14 15:53:21.503053 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.503030 2528 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 15:53:21.503757 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.503732 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75bvk\" (UniqueName: \"kubernetes.io/projected/afeb30b4-9a80-4d35-aa77-0074ffb33370-kube-api-access-75bvk\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.503851 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.503774 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tht2p\" (UniqueName: \"kubernetes.io/projected/192f9064-28fa-4ccc-aae0-e6157e6ac308-kube-api-access-tht2p\") pod \"node-ca-x29bp\" (UID: \"192f9064-28fa-4ccc-aae0-e6157e6ac308\") " pod="openshift-image-registry/node-ca-x29bp" Jun 14 15:53:21.503851 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.503801 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-run-systemd\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.503851 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.503826 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-node-log\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.503851 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.503841 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2dab904e-fc99-45bb-9362-0df3da6dcdc1-socket-dir\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.504052 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.503893 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-hostroot\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.504052 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.503952 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/07d6f6c8-b332-424e-b657-0a6cfe599959-cnibin\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.504052 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.503989 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/07d6f6c8-b332-424e-b657-0a6cfe599959-os-release\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.504052 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504020 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/07d6f6c8-b332-424e-b657-0a6cfe599959-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.504052 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504045 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad18bf63-5cb1-49ed-8747-cf53066d4757-hosts-file\") pod \"node-resolver-tv4zb\" (UID: \"ad18bf63-5cb1-49ed-8747-cf53066d4757\") " pod="openshift-dns/node-resolver-tv4zb" Jun 14 15:53:21.504332 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504070 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/afeb30b4-9a80-4d35-aa77-0074ffb33370-env-overrides\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.504332 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504114 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/afeb30b4-9a80-4d35-aa77-0074ffb33370-ovn-node-metrics-cert\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.504332 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504151 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/afeb30b4-9a80-4d35-aa77-0074ffb33370-ovnkube-script-lib\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.504332 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504203 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-log-socket\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.504332 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504252 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-os-release\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.504332 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504277 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d1ec93e-24ee-451f-a4bd-cb8281280b21-cni-binary-copy\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.504332 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504300 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07df90f6-3e95-433f-bce9-29fb97c0fb35-dbus\") pod \"global-pull-secret-syncer-w9q49\" (UID: \"07df90f6-3e95-433f-bce9-29fb97c0fb35\") " pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:21.504332 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504324 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-kubelet\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.505534 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504350 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-etc-openvswitch\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.505534 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504386 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2dab904e-fc99-45bb-9362-0df3da6dcdc1-registration-dir\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.505534 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504426 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-cnibin\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.505534 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504458 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/07d6f6c8-b332-424e-b657-0a6cfe599959-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.505534 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504500 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2dab904e-fc99-45bb-9362-0df3da6dcdc1-sys-fs\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.505534 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504525 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg76d\" (UniqueName: \"kubernetes.io/projected/2dab904e-fc99-45bb-9362-0df3da6dcdc1-kube-api-access-fg76d\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.505534 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504548 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-multus-cni-dir\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.505534 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504571 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-slash\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.505534 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504609 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-run-netns\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.505534 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504640 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-cni-bin\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.505534 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504666 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-cni-netd\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.505534 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504689 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-run-ovn-kubernetes\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.505534 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504717 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82h5w\" (UniqueName: \"kubernetes.io/projected/8d1ec93e-24ee-451f-a4bd-cb8281280b21-kube-api-access-82h5w\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.505534 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504729 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:21.505534 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504742 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dab904e-fc99-45bb-9362-0df3da6dcdc1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.505534 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504765 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-multus-socket-dir-parent\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.505534 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504787 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad18bf63-5cb1-49ed-8747-cf53066d4757-tmp-dir\") pod \"node-resolver-tv4zb\" (UID: \"ad18bf63-5cb1-49ed-8747-cf53066d4757\") " pod="openshift-dns/node-resolver-tv4zb" Jun 14 15:53:21.506443 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:21.504803 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgn2" podUID="1413db4b-a032-4c35-85d3-1a8976c37f1b" Jun 14 15:53:21.506443 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504829 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/549f07ae-a352-4940-bc1e-5f4e737b95c2-konnectivity-ca\") pod \"konnectivity-agent-6jp7n\" (UID: \"549f07ae-a352-4940-bc1e-5f4e737b95c2\") " pod="kube-system/konnectivity-agent-6jp7n" Jun 14 15:53:21.506443 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504854 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-host-run-k8s-cni-cncf-io\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.506443 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504878 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwxgb\" (UniqueName: \"kubernetes.io/projected/ad18bf63-5cb1-49ed-8747-cf53066d4757-kube-api-access-xwxgb\") pod \"node-resolver-tv4zb\" (UID: \"ad18bf63-5cb1-49ed-8747-cf53066d4757\") " pod="openshift-dns/node-resolver-tv4zb" Jun 14 15:53:21.506443 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504913 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/192f9064-28fa-4ccc-aae0-e6157e6ac308-host\") pod \"node-ca-x29bp\" (UID: \"192f9064-28fa-4ccc-aae0-e6157e6ac308\") " pod="openshift-image-registry/node-ca-x29bp" Jun 14 15:53:21.506443 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504956 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret\") pod \"global-pull-secret-syncer-w9q49\" (UID: \"07df90f6-3e95-433f-bce9-29fb97c0fb35\") " pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:21.506443 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.504987 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/549f07ae-a352-4940-bc1e-5f4e737b95c2-agent-certs\") pod \"konnectivity-agent-6jp7n\" (UID: \"549f07ae-a352-4940-bc1e-5f4e737b95c2\") " pod="kube-system/konnectivity-agent-6jp7n" Jun 14 15:53:21.506443 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505012 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/07d6f6c8-b332-424e-b657-0a6cfe599959-system-cni-dir\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.506443 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505047 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/07d6f6c8-b332-424e-b657-0a6cfe599959-cni-binary-copy\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.506443 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505066 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2dab904e-fc99-45bb-9362-0df3da6dcdc1-etc-selinux\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.506443 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505081 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-host-run-netns\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.506443 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505095 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-multus-conf-dir\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.506443 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505116 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-host-run-multus-certs\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.506443 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505148 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-etc-kubernetes\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.506443 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505180 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-run-openvswitch\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.506443 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505206 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-run-ovn\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.507195 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505263 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9nfj\" (UniqueName: \"kubernetes.io/projected/07d6f6c8-b332-424e-b657-0a6cfe599959-kube-api-access-l9nfj\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.507195 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505305 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/afeb30b4-9a80-4d35-aa77-0074ffb33370-ovnkube-config\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.507195 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505336 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/07d6f6c8-b332-424e-b657-0a6cfe599959-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.507195 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505360 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-system-cni-dir\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.507195 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505382 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-host-var-lib-cni-bin\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.507195 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505408 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-host-var-lib-cni-multus\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.507195 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505436 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/192f9064-28fa-4ccc-aae0-e6157e6ac308-serviceca\") pod \"node-ca-x29bp\" (UID: \"192f9064-28fa-4ccc-aae0-e6157e6ac308\") " pod="openshift-image-registry/node-ca-x29bp" Jun 14 15:53:21.507195 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505470 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-systemd-units\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.507195 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505495 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-host-var-lib-kubelet\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.507195 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505519 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-var-lib-openvswitch\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.507195 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505574 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.507195 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505609 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d1ec93e-24ee-451f-a4bd-cb8281280b21-multus-daemon-config\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.507195 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505632 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07df90f6-3e95-433f-bce9-29fb97c0fb35-kubelet-config\") pod \"global-pull-secret-syncer-w9q49\" (UID: \"07df90f6-3e95-433f-bce9-29fb97c0fb35\") " pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:21.507195 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.505660 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2dab904e-fc99-45bb-9362-0df3da6dcdc1-device-dir\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.507195 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.507193 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-snhpz" Jun 14 15:53:21.509070 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.509048 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 15:53:21.509922 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.509903 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mm552\"" Jun 14 15:53:21.510117 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.510101 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 15:53:21.510267 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.510243 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 15:53:21.529393 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.529368 2528 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v2mvn" Jun 14 15:53:21.536975 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.536948 2528 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v2mvn" Jun 14 15:53:21.570477 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.570423 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" event={"ID":"ea196915da4e135b9afcd0fb87c4a58d","Type":"ContainerStarted","Data":"6a295e01b1dbe670b6032d149fe5a5cbe4c9316d87459aeaaef8dc4e427ea521"} Jun 14 15:53:21.571803 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.571766 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal" event={"ID":"c8e3889a791d0c7f22f6182a8170d3ff","Type":"ContainerStarted","Data":"ba1f38e189beb34b6f874550d389e9d4e944b426008f3743f18f7646fb2f53d5"} Jun 14 15:53:21.592145 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.592106 2528 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 15:53:21.605990 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.605956 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scxcd\" (UniqueName: \"kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd\") pod \"network-check-target-frgn2\" (UID: \"1413db4b-a032-4c35-85d3-1a8976c37f1b\") " pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:21.605990 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606004 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad18bf63-5cb1-49ed-8747-cf53066d4757-hosts-file\") pod \"node-resolver-tv4zb\" (UID: \"ad18bf63-5cb1-49ed-8747-cf53066d4757\") " pod="openshift-dns/node-resolver-tv4zb" Jun 14 15:53:21.606280 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606032 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/afeb30b4-9a80-4d35-aa77-0074ffb33370-env-overrides\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.606280 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606114 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad18bf63-5cb1-49ed-8747-cf53066d4757-hosts-file\") pod \"node-resolver-tv4zb\" (UID: \"ad18bf63-5cb1-49ed-8747-cf53066d4757\") " pod="openshift-dns/node-resolver-tv4zb" Jun 14 15:53:21.606280 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606143 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/afeb30b4-9a80-4d35-aa77-0074ffb33370-ovn-node-metrics-cert\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.606280 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606177 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/afeb30b4-9a80-4d35-aa77-0074ffb33370-ovnkube-script-lib\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.606280 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606204 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-lib-modules\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.606280 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606245 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-log-socket\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.606280 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606269 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-sysconfig\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.606659 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606292 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-sys\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.606659 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606314 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4w7v\" (UniqueName: \"kubernetes.io/projected/36c343bd-9776-45d6-9fd4-6994edafd550-kube-api-access-n4w7v\") pod \"network-metrics-daemon-t5kjf\" (UID: \"36c343bd-9776-45d6-9fd4-6994edafd550\") " pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:21.606659 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606341 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-os-release\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.606659 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606367 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d1ec93e-24ee-451f-a4bd-cb8281280b21-cni-binary-copy\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.606659 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606392 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07df90f6-3e95-433f-bce9-29fb97c0fb35-dbus\") pod \"global-pull-secret-syncer-w9q49\" (UID: \"07df90f6-3e95-433f-bce9-29fb97c0fb35\") " pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:21.606659 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606416 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-kubelet\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.606659 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606438 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-etc-openvswitch\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.606659 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606462 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e-host-slash\") pod \"iptables-alerter-snhpz\" (UID: \"f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e\") " pod="openshift-network-operator/iptables-alerter-snhpz" Jun 14 15:53:21.606659 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606484 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-kubernetes\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.606659 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606506 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-sysctl-d\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.606659 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606532 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2dab904e-fc99-45bb-9362-0df3da6dcdc1-registration-dir\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.606659 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606519 2528 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 15:53:21.606659 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606563 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-cnibin\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.606659 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606586 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/07d6f6c8-b332-424e-b657-0a6cfe599959-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.606659 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606610 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2dab904e-fc99-45bb-9362-0df3da6dcdc1-sys-fs\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.606659 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606639 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg76d\" (UniqueName: \"kubernetes.io/projected/2dab904e-fc99-45bb-9362-0df3da6dcdc1-kube-api-access-fg76d\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.606659 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606660 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-multus-cni-dir\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.607376 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606681 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-slash\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.607376 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606701 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-run-netns\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.607376 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606726 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-cni-bin\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.607376 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606751 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-cni-netd\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.607376 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606807 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-cni-netd\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.607376 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606951 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07df90f6-3e95-433f-bce9-29fb97c0fb35-dbus\") pod \"global-pull-secret-syncer-w9q49\" (UID: \"07df90f6-3e95-433f-bce9-29fb97c0fb35\") " pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:21.607376 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606990 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-kubelet\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.607376 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607029 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-etc-openvswitch\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.607376 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607106 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2dab904e-fc99-45bb-9362-0df3da6dcdc1-registration-dir\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.607376 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607310 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/afeb30b4-9a80-4d35-aa77-0074ffb33370-ovnkube-script-lib\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.607376 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607313 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-cnibin\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.607752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607400 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-systemd\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.607752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607424 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-run-ovn-kubernetes\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.607752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607453 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82h5w\" (UniqueName: \"kubernetes.io/projected/8d1ec93e-24ee-451f-a4bd-cb8281280b21-kube-api-access-82h5w\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.607752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607482 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dab904e-fc99-45bb-9362-0df3da6dcdc1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.607752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607506 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-multus-socket-dir-parent\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.607752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607525 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad18bf63-5cb1-49ed-8747-cf53066d4757-tmp-dir\") pod \"node-resolver-tv4zb\" (UID: \"ad18bf63-5cb1-49ed-8747-cf53066d4757\") " pod="openshift-dns/node-resolver-tv4zb" Jun 14 15:53:21.607752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607546 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/549f07ae-a352-4940-bc1e-5f4e737b95c2-konnectivity-ca\") pod \"konnectivity-agent-6jp7n\" (UID: \"549f07ae-a352-4940-bc1e-5f4e737b95c2\") " pod="kube-system/konnectivity-agent-6jp7n" Jun 14 15:53:21.607752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607562 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-modprobe-d\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.607752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607577 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-host-run-k8s-cni-cncf-io\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.607752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607604 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwxgb\" (UniqueName: \"kubernetes.io/projected/ad18bf63-5cb1-49ed-8747-cf53066d4757-kube-api-access-xwxgb\") pod \"node-resolver-tv4zb\" (UID: \"ad18bf63-5cb1-49ed-8747-cf53066d4757\") " pod="openshift-dns/node-resolver-tv4zb" Jun 14 15:53:21.607752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607629 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/192f9064-28fa-4ccc-aae0-e6157e6ac308-host\") pod \"node-ca-x29bp\" (UID: \"192f9064-28fa-4ccc-aae0-e6157e6ac308\") " pod="openshift-image-registry/node-ca-x29bp" Jun 14 15:53:21.607752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607653 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret\") pod \"global-pull-secret-syncer-w9q49\" (UID: \"07df90f6-3e95-433f-bce9-29fb97c0fb35\") " pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:21.607752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607676 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/549f07ae-a352-4940-bc1e-5f4e737b95c2-agent-certs\") pod \"konnectivity-agent-6jp7n\" (UID: \"549f07ae-a352-4940-bc1e-5f4e737b95c2\") " pod="kube-system/konnectivity-agent-6jp7n" Jun 14 15:53:21.607752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607702 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/07d6f6c8-b332-424e-b657-0a6cfe599959-system-cni-dir\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.607752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607721 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/07d6f6c8-b332-424e-b657-0a6cfe599959-cni-binary-copy\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.607752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607738 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2dab904e-fc99-45bb-9362-0df3da6dcdc1-etc-selinux\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.607752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607755 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-host-run-netns\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.608564 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607794 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-multus-conf-dir\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.608564 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607818 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-host-run-multus-certs\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.608564 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607844 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-etc-kubernetes\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.608564 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607846 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/07d6f6c8-b332-424e-b657-0a6cfe599959-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.608564 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607853 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d1ec93e-24ee-451f-a4bd-cb8281280b21-cni-binary-copy\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.608564 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.606587 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/afeb30b4-9a80-4d35-aa77-0074ffb33370-env-overrides\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.608564 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607875 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-run-openvswitch\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.608564 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607933 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-run-ovn\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.608564 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.607956 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-os-release\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.608564 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608058 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-run-openvswitch\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.608564 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608167 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9nfj\" (UniqueName: \"kubernetes.io/projected/07d6f6c8-b332-424e-b657-0a6cfe599959-kube-api-access-l9nfj\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.608564 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608201 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/afeb30b4-9a80-4d35-aa77-0074ffb33370-ovnkube-config\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.608564 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608246 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/07d6f6c8-b332-424e-b657-0a6cfe599959-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.608564 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608260 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-slash\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.608564 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608267 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-tuned\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.608564 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608305 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs\") pod \"network-metrics-daemon-t5kjf\" (UID: \"36c343bd-9776-45d6-9fd4-6994edafd550\") " pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:21.608564 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608335 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e-iptables-alerter-script\") pod \"iptables-alerter-snhpz\" (UID: \"f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e\") " pod="openshift-network-operator/iptables-alerter-snhpz" Jun 14 15:53:21.609575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608364 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-system-cni-dir\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.609575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608369 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-run-netns\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.609575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608391 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-host-var-lib-cni-bin\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.609575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608406 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-host-run-netns\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.609575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608416 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-host-var-lib-cni-multus\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.609575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608440 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2dab904e-fc99-45bb-9362-0df3da6dcdc1-etc-selinux\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.609575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608444 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/192f9064-28fa-4ccc-aae0-e6157e6ac308-serviceca\") pod \"node-ca-x29bp\" (UID: \"192f9064-28fa-4ccc-aae0-e6157e6ac308\") " pod="openshift-image-registry/node-ca-x29bp" Jun 14 15:53:21.609575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608473 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-systemd-units\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.609575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608478 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-cni-bin\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.609575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608495 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-run\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.609575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608513 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-multus-conf-dir\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.609575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608554 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-host-run-k8s-cni-cncf-io\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.609575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608586 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/07d6f6c8-b332-424e-b657-0a6cfe599959-system-cni-dir\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.609575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608337 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-multus-cni-dir\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.609575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608517 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-host\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.609575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.608914 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-run-ovn\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.609575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609059 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/07d6f6c8-b332-424e-b657-0a6cfe599959-cni-binary-copy\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.609575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609115 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-log-socket\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.610347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609142 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-host-run-multus-certs\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.610347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609145 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2dab904e-fc99-45bb-9362-0df3da6dcdc1-sys-fs\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.610347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609177 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-run-ovn-kubernetes\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.610347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609274 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-host-var-lib-kubelet\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.610347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609300 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/07d6f6c8-b332-424e-b657-0a6cfe599959-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.610347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609304 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-var-lib-openvswitch\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.610347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609492 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.610347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609514 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-tmp\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.610347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609538 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml8d8\" (UniqueName: \"kubernetes.io/projected/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-kube-api-access-ml8d8\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.610347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609392 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-host-var-lib-cni-bin\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.610347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609329 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-var-lib-openvswitch\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.610347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609461 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dab904e-fc99-45bb-9362-0df3da6dcdc1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.610347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609599 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.610347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609544 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-multus-socket-dir-parent\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.610347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609409 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-systemd-units\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.610347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609375 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-system-cni-dir\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.610347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609347 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-host-var-lib-cni-multus\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.611108 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609493 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/192f9064-28fa-4ccc-aae0-e6157e6ac308-host\") pod \"node-ca-x29bp\" (UID: \"192f9064-28fa-4ccc-aae0-e6157e6ac308\") " pod="openshift-image-registry/node-ca-x29bp" Jun 14 15:53:21.611108 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609651 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dlsm\" (UniqueName: \"kubernetes.io/projected/f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e-kube-api-access-8dlsm\") pod \"iptables-alerter-snhpz\" (UID: \"f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e\") " pod="openshift-network-operator/iptables-alerter-snhpz" Jun 14 15:53:21.611108 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609689 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d1ec93e-24ee-451f-a4bd-cb8281280b21-multus-daemon-config\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.611108 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609727 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/192f9064-28fa-4ccc-aae0-e6157e6ac308-serviceca\") pod \"node-ca-x29bp\" (UID: \"192f9064-28fa-4ccc-aae0-e6157e6ac308\") " pod="openshift-image-registry/node-ca-x29bp" Jun 14 15:53:21.611108 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:21.609813 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:53:21.611108 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609855 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07df90f6-3e95-433f-bce9-29fb97c0fb35-kubelet-config\") pod \"global-pull-secret-syncer-w9q49\" (UID: \"07df90f6-3e95-433f-bce9-29fb97c0fb35\") " pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:21.611108 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:21.609892 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret podName:07df90f6-3e95-433f-bce9-29fb97c0fb35 nodeName:}" failed. No retries permitted until 2026-06-14 15:53:22.109870213 +0000 UTC m=+3.039517908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret") pod "global-pull-secret-syncer-w9q49" (UID: "07df90f6-3e95-433f-bce9-29fb97c0fb35") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:53:21.611108 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609907 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07df90f6-3e95-433f-bce9-29fb97c0fb35-kubelet-config\") pod \"global-pull-secret-syncer-w9q49\" (UID: \"07df90f6-3e95-433f-bce9-29fb97c0fb35\") " pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:21.611108 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609923 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-var-lib-kubelet\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.611108 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609934 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/afeb30b4-9a80-4d35-aa77-0074ffb33370-ovnkube-config\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.611108 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609961 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2dab904e-fc99-45bb-9362-0df3da6dcdc1-device-dir\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.611108 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609976 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad18bf63-5cb1-49ed-8747-cf53066d4757-tmp-dir\") pod \"node-resolver-tv4zb\" (UID: \"ad18bf63-5cb1-49ed-8747-cf53066d4757\") " pod="openshift-dns/node-resolver-tv4zb" Jun 14 15:53:21.611108 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609991 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75bvk\" (UniqueName: \"kubernetes.io/projected/afeb30b4-9a80-4d35-aa77-0074ffb33370-kube-api-access-75bvk\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.611108 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610019 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tht2p\" (UniqueName: \"kubernetes.io/projected/192f9064-28fa-4ccc-aae0-e6157e6ac308-kube-api-access-tht2p\") pod \"node-ca-x29bp\" (UID: \"192f9064-28fa-4ccc-aae0-e6157e6ac308\") " pod="openshift-image-registry/node-ca-x29bp" Jun 14 15:53:21.611108 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.609991 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-host-var-lib-kubelet\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.611108 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610074 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-run-systemd\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.611108 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610083 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/549f07ae-a352-4940-bc1e-5f4e737b95c2-konnectivity-ca\") pod \"konnectivity-agent-6jp7n\" (UID: \"549f07ae-a352-4940-bc1e-5f4e737b95c2\") " pod="kube-system/konnectivity-agent-6jp7n" Jun 14 15:53:21.611750 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610105 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-node-log\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.611750 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610135 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-sysctl-conf\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.611750 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610232 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2dab904e-fc99-45bb-9362-0df3da6dcdc1-device-dir\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.611750 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610209 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2dab904e-fc99-45bb-9362-0df3da6dcdc1-socket-dir\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.611750 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610262 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-etc-kubernetes\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.611750 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610272 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-run-systemd\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.611750 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610284 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-hostroot\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.611750 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610313 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/07d6f6c8-b332-424e-b657-0a6cfe599959-cnibin\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.611750 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610357 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2dab904e-fc99-45bb-9362-0df3da6dcdc1-socket-dir\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.611750 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610371 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8d1ec93e-24ee-451f-a4bd-cb8281280b21-hostroot\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.611750 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610382 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/afeb30b4-9a80-4d35-aa77-0074ffb33370-node-log\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.611750 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610394 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/07d6f6c8-b332-424e-b657-0a6cfe599959-cnibin\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.611750 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610404 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/07d6f6c8-b332-424e-b657-0a6cfe599959-os-release\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.611750 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610423 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8d1ec93e-24ee-451f-a4bd-cb8281280b21-multus-daemon-config\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.611750 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610443 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/07d6f6c8-b332-424e-b657-0a6cfe599959-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.611750 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610472 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/07d6f6c8-b332-424e-b657-0a6cfe599959-os-release\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.611750 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610749 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/afeb30b4-9a80-4d35-aa77-0074ffb33370-ovn-node-metrics-cert\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.612298 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.610935 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/07d6f6c8-b332-424e-b657-0a6cfe599959-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.612298 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.611436 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/549f07ae-a352-4940-bc1e-5f4e737b95c2-agent-certs\") pod \"konnectivity-agent-6jp7n\" (UID: \"549f07ae-a352-4940-bc1e-5f4e737b95c2\") " pod="kube-system/konnectivity-agent-6jp7n" Jun 14 15:53:21.620995 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.620956 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9nfj\" (UniqueName: \"kubernetes.io/projected/07d6f6c8-b332-424e-b657-0a6cfe599959-kube-api-access-l9nfj\") pod \"multus-additional-cni-plugins-rbxp5\" (UID: \"07d6f6c8-b332-424e-b657-0a6cfe599959\") " pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.621243 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.621203 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tht2p\" (UniqueName: \"kubernetes.io/projected/192f9064-28fa-4ccc-aae0-e6157e6ac308-kube-api-access-tht2p\") pod \"node-ca-x29bp\" (UID: \"192f9064-28fa-4ccc-aae0-e6157e6ac308\") " pod="openshift-image-registry/node-ca-x29bp" Jun 14 15:53:21.621474 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.621442 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwxgb\" (UniqueName: \"kubernetes.io/projected/ad18bf63-5cb1-49ed-8747-cf53066d4757-kube-api-access-xwxgb\") pod \"node-resolver-tv4zb\" (UID: \"ad18bf63-5cb1-49ed-8747-cf53066d4757\") " pod="openshift-dns/node-resolver-tv4zb" Jun 14 15:53:21.621899 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.621873 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82h5w\" (UniqueName: \"kubernetes.io/projected/8d1ec93e-24ee-451f-a4bd-cb8281280b21-kube-api-access-82h5w\") pod \"multus-dl45m\" (UID: \"8d1ec93e-24ee-451f-a4bd-cb8281280b21\") " pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.621977 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.621952 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg76d\" (UniqueName: \"kubernetes.io/projected/2dab904e-fc99-45bb-9362-0df3da6dcdc1-kube-api-access-fg76d\") pod \"aws-ebs-csi-driver-node-4h492\" (UID: \"2dab904e-fc99-45bb-9362-0df3da6dcdc1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.622092 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.622069 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75bvk\" (UniqueName: \"kubernetes.io/projected/afeb30b4-9a80-4d35-aa77-0074ffb33370-kube-api-access-75bvk\") pod \"ovnkube-node-mqv4x\" (UID: \"afeb30b4-9a80-4d35-aa77-0074ffb33370\") " pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.711300 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711184 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-sysctl-conf\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.711300 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711251 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scxcd\" (UniqueName: \"kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd\") pod \"network-check-target-frgn2\" (UID: \"1413db4b-a032-4c35-85d3-1a8976c37f1b\") " pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:21.711300 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711276 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-lib-modules\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.711300 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711296 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-sysconfig\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.711620 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711316 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-sys\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.711620 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711336 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4w7v\" (UniqueName: \"kubernetes.io/projected/36c343bd-9776-45d6-9fd4-6994edafd550-kube-api-access-n4w7v\") pod \"network-metrics-daemon-t5kjf\" (UID: \"36c343bd-9776-45d6-9fd4-6994edafd550\") " pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:21.711620 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711360 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e-host-slash\") pod \"iptables-alerter-snhpz\" (UID: \"f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e\") " pod="openshift-network-operator/iptables-alerter-snhpz" Jun 14 15:53:21.711620 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711382 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-kubernetes\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.711620 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711402 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-sysctl-d\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.711620 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711404 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-sysctl-conf\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.711620 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711434 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-systemd\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.711620 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711461 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-modprobe-d\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.711620 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711511 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-tuned\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.711620 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711532 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs\") pod \"network-metrics-daemon-t5kjf\" (UID: \"36c343bd-9776-45d6-9fd4-6994edafd550\") " pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:21.711620 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711555 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e-iptables-alerter-script\") pod \"iptables-alerter-snhpz\" (UID: \"f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e\") " pod="openshift-network-operator/iptables-alerter-snhpz" Jun 14 15:53:21.711620 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711584 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-run\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.711620 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711603 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-host\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.711620 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711616 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-systemd\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.711620 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711628 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-tmp\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.712427 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711651 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml8d8\" (UniqueName: \"kubernetes.io/projected/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-kube-api-access-ml8d8\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.712427 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711675 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e-host-slash\") pod \"iptables-alerter-snhpz\" (UID: \"f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e\") " pod="openshift-network-operator/iptables-alerter-snhpz" Jun 14 15:53:21.712427 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711726 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-kubernetes\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.712427 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711756 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-modprobe-d\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.712427 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711756 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-lib-modules\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.712427 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711777 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dlsm\" (UniqueName: \"kubernetes.io/projected/f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e-kube-api-access-8dlsm\") pod \"iptables-alerter-snhpz\" (UID: \"f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e\") " pod="openshift-network-operator/iptables-alerter-snhpz" Jun 14 15:53:21.712427 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711806 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-var-lib-kubelet\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.712427 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.711828 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-sysctl-d\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.712427 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.712098 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-var-lib-kubelet\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.712427 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.712141 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-host\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.712427 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.712149 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-sys\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.712427 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.712182 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-sysconfig\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.712427 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:21.712259 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:53:21.712427 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:21.712364 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs podName:36c343bd-9776-45d6-9fd4-6994edafd550 nodeName:}" failed. No retries permitted until 2026-06-14 15:53:22.212343052 +0000 UTC m=+3.141990728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs") pod "network-metrics-daemon-t5kjf" (UID: "36c343bd-9776-45d6-9fd4-6994edafd550") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:53:21.713061 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.712662 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-run\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.713061 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.712923 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e-iptables-alerter-script\") pod \"iptables-alerter-snhpz\" (UID: \"f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e\") " pod="openshift-network-operator/iptables-alerter-snhpz" Jun 14 15:53:21.714403 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.714373 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-tmp\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.714525 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.714430 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-etc-tuned\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.717731 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:21.717312 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:53:21.717731 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:21.717338 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:53:21.717731 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:21.717378 2528 projected.go:196] Error preparing data for projected volume kube-api-access-scxcd for pod openshift-network-diagnostics/network-check-target-frgn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:53:21.717731 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:21.717579 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd podName:1413db4b-a032-4c35-85d3-1a8976c37f1b nodeName:}" failed. No retries permitted until 2026-06-14 15:53:22.217560079 +0000 UTC m=+3.147207751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-scxcd" (UniqueName: "kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd") pod "network-check-target-frgn2" (UID: "1413db4b-a032-4c35-85d3-1a8976c37f1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:53:21.719728 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.719701 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4w7v\" (UniqueName: \"kubernetes.io/projected/36c343bd-9776-45d6-9fd4-6994edafd550-kube-api-access-n4w7v\") pod \"network-metrics-daemon-t5kjf\" (UID: \"36c343bd-9776-45d6-9fd4-6994edafd550\") " pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:21.721443 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.721420 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml8d8\" (UniqueName: \"kubernetes.io/projected/b37b1d2a-fa7a-4d90-a432-a485ba4de7f9-kube-api-access-ml8d8\") pod \"tuned-bwnfq\" (UID: \"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9\") " pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.722507 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.722481 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dlsm\" (UniqueName: \"kubernetes.io/projected/f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e-kube-api-access-8dlsm\") pod \"iptables-alerter-snhpz\" (UID: \"f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e\") " pod="openshift-network-operator/iptables-alerter-snhpz" Jun 14 15:53:21.787003 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.786966 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" Jun 14 15:53:21.798322 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.798292 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dl45m" Jun 14 15:53:21.808267 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.808237 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:21.813325 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.813304 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6jp7n" Jun 14 15:53:21.820385 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.820362 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tv4zb" Jun 14 15:53:21.827538 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.827503 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rbxp5" Jun 14 15:53:21.835520 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.835495 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x29bp" Jun 14 15:53:21.843557 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.843530 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" Jun 14 15:53:21.850983 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:21.850949 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-snhpz" Jun 14 15:53:22.114543 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:22.114454 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret\") pod \"global-pull-secret-syncer-w9q49\" (UID: \"07df90f6-3e95-433f-bce9-29fb97c0fb35\") " pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:22.114708 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:22.114632 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:53:22.114765 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:22.114720 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret podName:07df90f6-3e95-433f-bce9-29fb97c0fb35 nodeName:}" failed. No retries permitted until 2026-06-14 15:53:23.11469772 +0000 UTC m=+4.044345396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret") pod "global-pull-secret-syncer-w9q49" (UID: "07df90f6-3e95-433f-bce9-29fb97c0fb35") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:53:22.215269 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:22.215235 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs\") pod \"network-metrics-daemon-t5kjf\" (UID: \"36c343bd-9776-45d6-9fd4-6994edafd550\") " pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:22.215468 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:22.215364 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:53:22.215468 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:22.215426 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs podName:36c343bd-9776-45d6-9fd4-6994edafd550 nodeName:}" failed. No retries permitted until 2026-06-14 15:53:23.215410573 +0000 UTC m=+4.145058248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs") pod "network-metrics-daemon-t5kjf" (UID: "36c343bd-9776-45d6-9fd4-6994edafd550") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:53:22.315852 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:22.315810 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scxcd\" (UniqueName: \"kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd\") pod \"network-check-target-frgn2\" (UID: \"1413db4b-a032-4c35-85d3-1a8976c37f1b\") " pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:22.316029 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:22.315991 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:53:22.316029 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:22.316014 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:53:22.316029 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:22.316026 2528 projected.go:196] Error preparing data for projected volume kube-api-access-scxcd for pod openshift-network-diagnostics/network-check-target-frgn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:53:22.316207 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:22.316085 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd podName:1413db4b-a032-4c35-85d3-1a8976c37f1b nodeName:}" failed. No retries permitted until 2026-06-14 15:53:23.316069901 +0000 UTC m=+4.245717583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-scxcd" (UniqueName: "kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd") pod "network-check-target-frgn2" (UID: "1413db4b-a032-4c35-85d3-1a8976c37f1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:53:22.517776 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:22.517736 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod549f07ae_a352_4940_bc1e_5f4e737b95c2.slice/crio-0d49775829f52e4c15bb1536010f8c5205e7bdb4ff2a85fbc793f0c1f294c1f9 WatchSource:0}: Error finding container 0d49775829f52e4c15bb1536010f8c5205e7bdb4ff2a85fbc793f0c1f294c1f9: Status 404 returned error can't find the container with id 0d49775829f52e4c15bb1536010f8c5205e7bdb4ff2a85fbc793f0c1f294c1f9 Jun 14 15:53:22.519179 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:22.519057 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad18bf63_5cb1_49ed_8747_cf53066d4757.slice/crio-13b02ef5a7896d20aeef43b7003dc7bf828ddcb29fb321e5370ab67c87f100d9 WatchSource:0}: Error finding container 13b02ef5a7896d20aeef43b7003dc7bf828ddcb29fb321e5370ab67c87f100d9: Status 404 returned error can't find the container with id 13b02ef5a7896d20aeef43b7003dc7bf828ddcb29fb321e5370ab67c87f100d9 Jun 14 15:53:22.519841 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:22.519793 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2e469d0_d655_4bf3_bbb1_d7ef8273bb3e.slice/crio-64428ee027008badfb11a2020c41950179378f5e340dfa80f87e67d1de5b80b0 WatchSource:0}: Error finding container 64428ee027008badfb11a2020c41950179378f5e340dfa80f87e67d1de5b80b0: Status 404 returned error can't find the container with id 64428ee027008badfb11a2020c41950179378f5e340dfa80f87e67d1de5b80b0 Jun 14 15:53:22.521379 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:22.521362 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod192f9064_28fa_4ccc_aae0_e6157e6ac308.slice/crio-76f8644fb3dca39f976cd0dcfe909a15d2a8a999d45fd8c8a2ba0833ba1cfd53 WatchSource:0}: Error finding container 76f8644fb3dca39f976cd0dcfe909a15d2a8a999d45fd8c8a2ba0833ba1cfd53: Status 404 returned error can't find the container with id 76f8644fb3dca39f976cd0dcfe909a15d2a8a999d45fd8c8a2ba0833ba1cfd53 Jun 14 15:53:22.522506 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:22.522409 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafeb30b4_9a80_4d35_aa77_0074ffb33370.slice/crio-35edccdc172dc94eabcf4912c4b35469779a59ec0860b4645b4c7c8739dae962 WatchSource:0}: Error finding container 35edccdc172dc94eabcf4912c4b35469779a59ec0860b4645b4c7c8739dae962: Status 404 returned error can't find the container with id 35edccdc172dc94eabcf4912c4b35469779a59ec0860b4645b4c7c8739dae962 Jun 14 15:53:22.523180 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:22.523151 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07d6f6c8_b332_424e_b657_0a6cfe599959.slice/crio-119f0779839cc12a68b4c198350931924288720c0562534e7f44c307d6c0b69d WatchSource:0}: Error finding container 119f0779839cc12a68b4c198350931924288720c0562534e7f44c307d6c0b69d: Status 404 returned error can't find the container with id 119f0779839cc12a68b4c198350931924288720c0562534e7f44c307d6c0b69d Jun 14 15:53:22.525953 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:22.525916 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d1ec93e_24ee_451f_a4bd_cb8281280b21.slice/crio-dbc6b4335786968df387d2faf1661f8e10af7acb841ef9a23b108df4887347ad WatchSource:0}: Error finding container dbc6b4335786968df387d2faf1661f8e10af7acb841ef9a23b108df4887347ad: Status 404 returned error can't find the container with id dbc6b4335786968df387d2faf1661f8e10af7acb841ef9a23b108df4887347ad Jun 14 15:53:22.527427 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:22.527401 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb37b1d2a_fa7a_4d90_a432_a485ba4de7f9.slice/crio-efb182417616e337fcaca5829c0f2d7eab23d18d60de8f8c6efb702a4d49bfa7 WatchSource:0}: Error finding container efb182417616e337fcaca5829c0f2d7eab23d18d60de8f8c6efb702a4d49bfa7: Status 404 returned error can't find the container with id efb182417616e337fcaca5829c0f2d7eab23d18d60de8f8c6efb702a4d49bfa7 Jun 14 15:53:22.528590 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:22.528522 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dab904e_fc99_45bb_9362_0df3da6dcdc1.slice/crio-bccf1cc29324cb854e2b30a14a70218bfb20f2bded9d28d4ffbc82af7a509727 WatchSource:0}: Error finding container bccf1cc29324cb854e2b30a14a70218bfb20f2bded9d28d4ffbc82af7a509727: Status 404 returned error can't find the container with id bccf1cc29324cb854e2b30a14a70218bfb20f2bded9d28d4ffbc82af7a509727 Jun 14 15:53:22.540479 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:22.540415 2528 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 15:48:21 +0000 UTC" deadline="2027-12-28 23:37:14.189358639 +0000 UTC" Jun 14 15:53:22.540479 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:22.540475 2528 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13495h43m51.648886661s" Jun 14 15:53:22.574439 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:22.574399 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" event={"ID":"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9","Type":"ContainerStarted","Data":"efb182417616e337fcaca5829c0f2d7eab23d18d60de8f8c6efb702a4d49bfa7"} Jun 14 15:53:22.575379 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:22.575353 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" event={"ID":"2dab904e-fc99-45bb-9362-0df3da6dcdc1","Type":"ContainerStarted","Data":"bccf1cc29324cb854e2b30a14a70218bfb20f2bded9d28d4ffbc82af7a509727"} Jun 14 15:53:22.576310 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:22.576286 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-snhpz" event={"ID":"f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e","Type":"ContainerStarted","Data":"64428ee027008badfb11a2020c41950179378f5e340dfa80f87e67d1de5b80b0"} Jun 14 15:53:22.577334 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:22.577313 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x29bp" event={"ID":"192f9064-28fa-4ccc-aae0-e6157e6ac308","Type":"ContainerStarted","Data":"76f8644fb3dca39f976cd0dcfe909a15d2a8a999d45fd8c8a2ba0833ba1cfd53"} Jun 14 15:53:22.578637 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:22.578615 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dl45m" event={"ID":"8d1ec93e-24ee-451f-a4bd-cb8281280b21","Type":"ContainerStarted","Data":"dbc6b4335786968df387d2faf1661f8e10af7acb841ef9a23b108df4887347ad"} Jun 14 15:53:22.579839 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:22.579818 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbxp5" event={"ID":"07d6f6c8-b332-424e-b657-0a6cfe599959","Type":"ContainerStarted","Data":"119f0779839cc12a68b4c198350931924288720c0562534e7f44c307d6c0b69d"} Jun 14 15:53:22.580899 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:22.580873 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" event={"ID":"afeb30b4-9a80-4d35-aa77-0074ffb33370","Type":"ContainerStarted","Data":"35edccdc172dc94eabcf4912c4b35469779a59ec0860b4645b4c7c8739dae962"} Jun 14 15:53:22.587163 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:22.587120 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tv4zb" event={"ID":"ad18bf63-5cb1-49ed-8747-cf53066d4757","Type":"ContainerStarted","Data":"13b02ef5a7896d20aeef43b7003dc7bf828ddcb29fb321e5370ab67c87f100d9"} Jun 14 15:53:22.589967 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:22.589913 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6jp7n" event={"ID":"549f07ae-a352-4940-bc1e-5f4e737b95c2","Type":"ContainerStarted","Data":"0d49775829f52e4c15bb1536010f8c5205e7bdb4ff2a85fbc793f0c1f294c1f9"} Jun 14 15:53:23.122867 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:23.122262 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret\") pod \"global-pull-secret-syncer-w9q49\" (UID: \"07df90f6-3e95-433f-bce9-29fb97c0fb35\") " pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:23.122867 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:23.122405 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:53:23.122867 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:23.122469 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret podName:07df90f6-3e95-433f-bce9-29fb97c0fb35 nodeName:}" failed. No retries permitted until 2026-06-14 15:53:25.122450662 +0000 UTC m=+6.052098351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret") pod "global-pull-secret-syncer-w9q49" (UID: "07df90f6-3e95-433f-bce9-29fb97c0fb35") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:53:23.223674 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:23.223634 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs\") pod \"network-metrics-daemon-t5kjf\" (UID: \"36c343bd-9776-45d6-9fd4-6994edafd550\") " pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:23.223876 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:23.223819 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:53:23.223945 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:23.223886 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs podName:36c343bd-9776-45d6-9fd4-6994edafd550 nodeName:}" failed. No retries permitted until 2026-06-14 15:53:25.223867947 +0000 UTC m=+6.153515625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs") pod "network-metrics-daemon-t5kjf" (UID: "36c343bd-9776-45d6-9fd4-6994edafd550") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:53:23.325463 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:23.324850 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scxcd\" (UniqueName: \"kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd\") pod \"network-check-target-frgn2\" (UID: \"1413db4b-a032-4c35-85d3-1a8976c37f1b\") " pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:23.325463 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:23.325023 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:53:23.325463 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:23.325047 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:53:23.325463 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:23.325060 2528 projected.go:196] Error preparing data for projected volume kube-api-access-scxcd for pod openshift-network-diagnostics/network-check-target-frgn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:53:23.325463 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:23.325121 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd podName:1413db4b-a032-4c35-85d3-1a8976c37f1b nodeName:}" failed. No retries permitted until 2026-06-14 15:53:25.325100583 +0000 UTC m=+6.254748255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-scxcd" (UniqueName: "kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd") pod "network-check-target-frgn2" (UID: "1413db4b-a032-4c35-85d3-1a8976c37f1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:53:23.541112 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:23.541032 2528 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 15:48:21 +0000 UTC" deadline="2027-11-25 04:07:35.213851584 +0000 UTC" Jun 14 15:53:23.541112 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:23.541070 2528 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12684h14m11.672785777s" Jun 14 15:53:23.566960 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:23.566384 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:23.566960 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:23.566386 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:23.566960 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:23.566525 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgn2" podUID="1413db4b-a032-4c35-85d3-1a8976c37f1b" Jun 14 15:53:23.566960 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:23.566551 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:23.566960 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:23.566665 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5kjf" podUID="36c343bd-9776-45d6-9fd4-6994edafd550" Jun 14 15:53:23.566960 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:23.566776 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9q49" podUID="07df90f6-3e95-433f-bce9-29fb97c0fb35" Jun 14 15:53:23.654231 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:23.654166 2528 generic.go:356] "Generic (PLEG): container finished" podID="ea196915da4e135b9afcd0fb87c4a58d" containerID="037679b5ad0b95362084b096cc604678f0f76ec89be41cc1254d12258d0d49b5" exitCode=0 Jun 14 15:53:23.654394 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:23.654346 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" event={"ID":"ea196915da4e135b9afcd0fb87c4a58d","Type":"ContainerDied","Data":"037679b5ad0b95362084b096cc604678f0f76ec89be41cc1254d12258d0d49b5"} Jun 14 15:53:23.661703 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:23.660634 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal" event={"ID":"c8e3889a791d0c7f22f6182a8170d3ff","Type":"ContainerStarted","Data":"289d05044634b08bb319526e983d096bb29462da24c1036071ea2eb8de46f9dc"} Jun 14 15:53:23.690852 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:23.689574 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-112.ec2.internal" podStartSLOduration=2.689551457 podStartE2EDuration="2.689551457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:53:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:53:23.689347049 +0000 UTC m=+4.618994744" watchObservedRunningTime="2026-06-14 15:53:23.689551457 +0000 UTC m=+4.619199154" Jun 14 15:53:24.674236 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:24.674077 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" event={"ID":"ea196915da4e135b9afcd0fb87c4a58d","Type":"ContainerStarted","Data":"19ae24671ae2a8752ff899ffe2a7d51de43ec5b5ccb6d95e92cab2da67221580"} Jun 14 15:53:25.140239 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:25.140186 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret\") pod \"global-pull-secret-syncer-w9q49\" (UID: \"07df90f6-3e95-433f-bce9-29fb97c0fb35\") " pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:25.140434 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:25.140400 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:53:25.140511 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:25.140476 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret podName:07df90f6-3e95-433f-bce9-29fb97c0fb35 nodeName:}" failed. No retries permitted until 2026-06-14 15:53:29.14044743 +0000 UTC m=+10.070095120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret") pod "global-pull-secret-syncer-w9q49" (UID: "07df90f6-3e95-433f-bce9-29fb97c0fb35") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:53:25.241314 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:25.241258 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs\") pod \"network-metrics-daemon-t5kjf\" (UID: \"36c343bd-9776-45d6-9fd4-6994edafd550\") " pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:25.241517 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:25.241484 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:53:25.241588 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:25.241550 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs podName:36c343bd-9776-45d6-9fd4-6994edafd550 nodeName:}" failed. No retries permitted until 2026-06-14 15:53:29.241531831 +0000 UTC m=+10.171179506 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs") pod "network-metrics-daemon-t5kjf" (UID: "36c343bd-9776-45d6-9fd4-6994edafd550") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:53:25.342527 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:25.342484 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scxcd\" (UniqueName: \"kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd\") pod \"network-check-target-frgn2\" (UID: \"1413db4b-a032-4c35-85d3-1a8976c37f1b\") " pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:25.342743 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:25.342655 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:53:25.342743 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:25.342675 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:53:25.342743 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:25.342687 2528 projected.go:196] Error preparing data for projected volume kube-api-access-scxcd for pod openshift-network-diagnostics/network-check-target-frgn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:53:25.342935 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:25.342747 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd podName:1413db4b-a032-4c35-85d3-1a8976c37f1b nodeName:}" failed. No retries permitted until 2026-06-14 15:53:29.342729186 +0000 UTC m=+10.272376861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-scxcd" (UniqueName: "kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd") pod "network-check-target-frgn2" (UID: "1413db4b-a032-4c35-85d3-1a8976c37f1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:53:25.568496 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:25.568408 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:25.568663 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:25.568518 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgn2" podUID="1413db4b-a032-4c35-85d3-1a8976c37f1b" Jun 14 15:53:25.568827 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:25.568811 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:25.568907 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:25.568892 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9q49" podUID="07df90f6-3e95-433f-bce9-29fb97c0fb35" Jun 14 15:53:25.568973 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:25.568940 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:25.569039 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:25.569020 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5kjf" podUID="36c343bd-9776-45d6-9fd4-6994edafd550" Jun 14 15:53:27.566820 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:27.566778 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:27.567292 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:27.566785 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:27.567292 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:27.566912 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgn2" podUID="1413db4b-a032-4c35-85d3-1a8976c37f1b" Jun 14 15:53:27.567292 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:27.566931 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:27.567292 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:27.567037 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9q49" podUID="07df90f6-3e95-433f-bce9-29fb97c0fb35" Jun 14 15:53:27.567292 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:27.567131 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5kjf" podUID="36c343bd-9776-45d6-9fd4-6994edafd550" Jun 14 15:53:29.178505 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:29.178461 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret\") pod \"global-pull-secret-syncer-w9q49\" (UID: \"07df90f6-3e95-433f-bce9-29fb97c0fb35\") " pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:29.178979 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:29.178605 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:53:29.178979 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:29.178695 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret podName:07df90f6-3e95-433f-bce9-29fb97c0fb35 nodeName:}" failed. No retries permitted until 2026-06-14 15:53:37.178673669 +0000 UTC m=+18.108321353 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret") pod "global-pull-secret-syncer-w9q49" (UID: "07df90f6-3e95-433f-bce9-29fb97c0fb35") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:53:29.278902 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:29.278860 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs\") pod \"network-metrics-daemon-t5kjf\" (UID: \"36c343bd-9776-45d6-9fd4-6994edafd550\") " pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:29.279115 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:29.279096 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:53:29.279177 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:29.279172 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs podName:36c343bd-9776-45d6-9fd4-6994edafd550 nodeName:}" failed. No retries permitted until 2026-06-14 15:53:37.279151044 +0000 UTC m=+18.208798731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs") pod "network-metrics-daemon-t5kjf" (UID: "36c343bd-9776-45d6-9fd4-6994edafd550") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:53:29.379824 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:29.379773 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scxcd\" (UniqueName: \"kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd\") pod \"network-check-target-frgn2\" (UID: \"1413db4b-a032-4c35-85d3-1a8976c37f1b\") " pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:29.380013 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:29.379952 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:53:29.380013 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:29.379968 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:53:29.380013 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:29.379976 2528 projected.go:196] Error preparing data for projected volume kube-api-access-scxcd for pod openshift-network-diagnostics/network-check-target-frgn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:53:29.380164 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:29.380022 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd podName:1413db4b-a032-4c35-85d3-1a8976c37f1b nodeName:}" failed. No retries permitted until 2026-06-14 15:53:37.380010136 +0000 UTC m=+18.309657808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-scxcd" (UniqueName: "kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd") pod "network-check-target-frgn2" (UID: "1413db4b-a032-4c35-85d3-1a8976c37f1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:53:29.570549 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:29.570464 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:29.570716 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:29.570473 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:29.570716 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:29.570607 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgn2" podUID="1413db4b-a032-4c35-85d3-1a8976c37f1b" Jun 14 15:53:29.570716 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:29.570659 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:29.570867 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:29.570808 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9q49" podUID="07df90f6-3e95-433f-bce9-29fb97c0fb35" Jun 14 15:53:29.570984 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:29.570946 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5kjf" podUID="36c343bd-9776-45d6-9fd4-6994edafd550" Jun 14 15:53:31.570287 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:31.570251 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:31.570699 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:31.570386 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgn2" podUID="1413db4b-a032-4c35-85d3-1a8976c37f1b" Jun 14 15:53:31.570812 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:31.570791 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:31.570892 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:31.570877 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9q49" podUID="07df90f6-3e95-433f-bce9-29fb97c0fb35" Jun 14 15:53:31.570950 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:31.570934 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:31.571025 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:31.570993 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5kjf" podUID="36c343bd-9776-45d6-9fd4-6994edafd550" Jun 14 15:53:33.566763 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:33.566728 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:33.566763 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:33.566763 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:33.567318 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:33.566728 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:33.567318 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:33.566860 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgn2" podUID="1413db4b-a032-4c35-85d3-1a8976c37f1b" Jun 14 15:53:33.567318 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:33.566944 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5kjf" podUID="36c343bd-9776-45d6-9fd4-6994edafd550" Jun 14 15:53:33.567318 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:33.567019 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9q49" podUID="07df90f6-3e95-433f-bce9-29fb97c0fb35" Jun 14 15:53:35.570104 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:35.570073 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:35.570565 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:35.570122 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:35.570565 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:35.570206 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5kjf" podUID="36c343bd-9776-45d6-9fd4-6994edafd550" Jun 14 15:53:35.570565 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:35.570289 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgn2" podUID="1413db4b-a032-4c35-85d3-1a8976c37f1b" Jun 14 15:53:35.570565 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:35.570340 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:35.570565 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:35.570412 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9q49" podUID="07df90f6-3e95-433f-bce9-29fb97c0fb35" Jun 14 15:53:37.239234 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:37.239185 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret\") pod \"global-pull-secret-syncer-w9q49\" (UID: \"07df90f6-3e95-433f-bce9-29fb97c0fb35\") " pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:37.239702 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:37.239371 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:53:37.239702 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:37.239444 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret podName:07df90f6-3e95-433f-bce9-29fb97c0fb35 nodeName:}" failed. No retries permitted until 2026-06-14 15:53:53.239423881 +0000 UTC m=+34.169071570 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret") pod "global-pull-secret-syncer-w9q49" (UID: "07df90f6-3e95-433f-bce9-29fb97c0fb35") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:53:37.340269 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:37.340224 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs\") pod \"network-metrics-daemon-t5kjf\" (UID: \"36c343bd-9776-45d6-9fd4-6994edafd550\") " pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:37.340427 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:37.340359 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:53:37.340427 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:37.340420 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs podName:36c343bd-9776-45d6-9fd4-6994edafd550 nodeName:}" failed. No retries permitted until 2026-06-14 15:53:53.340406143 +0000 UTC m=+34.270053817 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs") pod "network-metrics-daemon-t5kjf" (UID: "36c343bd-9776-45d6-9fd4-6994edafd550") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:53:37.441383 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:37.441343 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scxcd\" (UniqueName: \"kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd\") pod \"network-check-target-frgn2\" (UID: \"1413db4b-a032-4c35-85d3-1a8976c37f1b\") " pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:37.441576 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:37.441548 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:53:37.441646 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:37.441593 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:53:37.441646 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:37.441606 2528 projected.go:196] Error preparing data for projected volume kube-api-access-scxcd for pod openshift-network-diagnostics/network-check-target-frgn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:53:37.441731 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:37.441681 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd podName:1413db4b-a032-4c35-85d3-1a8976c37f1b nodeName:}" failed. No retries permitted until 2026-06-14 15:53:53.441659693 +0000 UTC m=+34.371307389 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-scxcd" (UniqueName: "kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd") pod "network-check-target-frgn2" (UID: "1413db4b-a032-4c35-85d3-1a8976c37f1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:53:37.569365 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:37.569287 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:37.569365 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:37.569332 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:37.569590 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:37.569287 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:37.569590 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:37.569411 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgn2" podUID="1413db4b-a032-4c35-85d3-1a8976c37f1b" Jun 14 15:53:37.569590 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:37.569536 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5kjf" podUID="36c343bd-9776-45d6-9fd4-6994edafd550" Jun 14 15:53:37.569735 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:37.569623 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9q49" podUID="07df90f6-3e95-433f-bce9-29fb97c0fb35" Jun 14 15:53:39.569052 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:39.569017 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:39.569052 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:39.569051 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:39.569621 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:39.569146 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5kjf" podUID="36c343bd-9776-45d6-9fd4-6994edafd550" Jun 14 15:53:39.569621 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:39.569178 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgn2" podUID="1413db4b-a032-4c35-85d3-1a8976c37f1b" Jun 14 15:53:39.569621 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:39.569233 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:39.569621 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:39.569307 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9q49" podUID="07df90f6-3e95-433f-bce9-29fb97c0fb35" Jun 14 15:53:41.574024 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:41.573776 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:41.574429 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:41.574129 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9q49" podUID="07df90f6-3e95-433f-bce9-29fb97c0fb35" Jun 14 15:53:41.574429 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:41.574416 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:41.574544 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:41.574513 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5kjf" podUID="36c343bd-9776-45d6-9fd4-6994edafd550" Jun 14 15:53:41.574607 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:41.574574 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:41.574664 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:41.574640 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgn2" podUID="1413db4b-a032-4c35-85d3-1a8976c37f1b" Jun 14 15:53:41.712140 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:41.711863 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6jp7n" event={"ID":"549f07ae-a352-4940-bc1e-5f4e737b95c2","Type":"ContainerStarted","Data":"a2b835901639003baea7a6934f08aefad0b0989b893febb7d06c95c7abd18062"} Jun 14 15:53:41.715566 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:41.715476 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" event={"ID":"b37b1d2a-fa7a-4d90-a432-a485ba4de7f9","Type":"ContainerStarted","Data":"8472b895a765121ef3ca2c3eeea0bb879c35ac00484f129cd59f4b1fb2ddf8eb"} Jun 14 15:53:41.717768 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:41.717728 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x29bp" event={"ID":"192f9064-28fa-4ccc-aae0-e6157e6ac308","Type":"ContainerStarted","Data":"9f006daff322541ceb5c1532cb64f7940d9b2be4720e78319a158ff5741dce78"} Jun 14 15:53:41.721335 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:41.721278 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dl45m" event={"ID":"8d1ec93e-24ee-451f-a4bd-cb8281280b21","Type":"ContainerStarted","Data":"d75b9092c886092d278a4e8c0cff2b25c9e6c6b51e928c6743d6bd2f0def7c81"} Jun 14 15:53:41.725876 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:41.723891 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbxp5" event={"ID":"07d6f6c8-b332-424e-b657-0a6cfe599959","Type":"ContainerStarted","Data":"bfb2bb746c59bc4149baeca6e0f555043502cfaf74f812af474cac56bb53f295"} Jun 14 15:53:41.725876 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:41.725303 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-112.ec2.internal" podStartSLOduration=21.725282506 podStartE2EDuration="21.725282506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:53:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:53:24.691133617 +0000 UTC m=+5.620781314" watchObservedRunningTime="2026-06-14 15:53:41.725282506 +0000 UTC m=+22.654930202" Jun 14 15:53:41.725876 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:41.725679 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6jp7n" podStartSLOduration=8.467250424 podStartE2EDuration="22.725666234s" totalImagesPullingTime="14.25841581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:53:41.72450987 +0000 UTC m=+22.654157565" watchObservedRunningTime="2026-06-14 15:53:41.725666234 +0000 UTC m=+22.655313930" Jun 14 15:53:41.748155 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:41.747586 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dl45m" podStartSLOduration=3.7501908349999997 podStartE2EDuration="22.747550065s" totalImagesPullingTime="18.99735923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:53:41.740794614 +0000 UTC m=+22.670442307" watchObservedRunningTime="2026-06-14 15:53:41.747550065 +0000 UTC m=+22.677197761" Jun 14 15:53:41.754903 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:41.754784 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-x29bp" podStartSLOduration=8.501277167 podStartE2EDuration="22.754761454s" totalImagesPullingTime="14.253484287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:53:41.754710083 +0000 UTC m=+22.684357782" watchObservedRunningTime="2026-06-14 15:53:41.754761454 +0000 UTC m=+22.684409151" Jun 14 15:53:41.792061 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:41.792000 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bwnfq" podStartSLOduration=3.820457433 podStartE2EDuration="22.791978518s" totalImagesPullingTime="18.971521085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:53:41.770665975 +0000 UTC m=+22.700313704" watchObservedRunningTime="2026-06-14 15:53:41.791978518 +0000 UTC m=+22.721626214" Jun 14 15:53:42.723900 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:42.723730 2528 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 15:53:42.730815 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:42.730775 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" event={"ID":"2dab904e-fc99-45bb-9362-0df3da6dcdc1","Type":"ContainerStarted","Data":"b7ab2d06c4b784977940df25ce00373ad9c4eb9b7bedaab326e57e42f21219b2"} Jun 14 15:53:42.730986 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:42.730865 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" event={"ID":"2dab904e-fc99-45bb-9362-0df3da6dcdc1","Type":"ContainerStarted","Data":"549344cee44030e6656f592f11d75c51f2721bee4b324879eed7d426d85db69e"} Jun 14 15:53:42.732151 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:42.732120 2528 generic.go:356] "Generic (PLEG): container finished" podID="07d6f6c8-b332-424e-b657-0a6cfe599959" containerID="bfb2bb746c59bc4149baeca6e0f555043502cfaf74f812af474cac56bb53f295" exitCode=0 Jun 14 15:53:42.732332 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:42.732196 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbxp5" event={"ID":"07d6f6c8-b332-424e-b657-0a6cfe599959","Type":"ContainerDied","Data":"bfb2bb746c59bc4149baeca6e0f555043502cfaf74f812af474cac56bb53f295"} Jun 14 15:53:42.735491 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:42.735461 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" event={"ID":"afeb30b4-9a80-4d35-aa77-0074ffb33370","Type":"ContainerStarted","Data":"dbdc216e47c90e110710b6a940eda360be949f4a20ea81fde9256c87f7b5e1b0"} Jun 14 15:53:42.735608 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:42.735549 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" event={"ID":"afeb30b4-9a80-4d35-aa77-0074ffb33370","Type":"ContainerStarted","Data":"3db89efc30822ff4b78307c5e97e9884d6914ff162e6f88df227fe7e2c497a69"} Jun 14 15:53:42.735608 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:42.735601 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" event={"ID":"afeb30b4-9a80-4d35-aa77-0074ffb33370","Type":"ContainerStarted","Data":"3b52dca4d7f9567965bf15bbb33ad8dc27e1eee6b542c12b782d80873b37cfe7"} Jun 14 15:53:42.735717 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:42.735650 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" event={"ID":"afeb30b4-9a80-4d35-aa77-0074ffb33370","Type":"ContainerStarted","Data":"b010dbb0640a4f25d6befbe5a26c73d5019463f6fe6ee05355d6e6e918f53648"} Jun 14 15:53:42.735717 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:42.735699 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" event={"ID":"afeb30b4-9a80-4d35-aa77-0074ffb33370","Type":"ContainerStarted","Data":"9490c97fe7350cc62d95d6ce6dafae106ba2e57c7c99058aefe4d740bef6fef6"} Jun 14 15:53:42.735810 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:42.735746 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" event={"ID":"afeb30b4-9a80-4d35-aa77-0074ffb33370","Type":"ContainerStarted","Data":"d101eee24e3733d9993f181d5a85cfc9e5668f89aae4d6ec8cb2d230801ca471"} Jun 14 15:53:42.737061 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:42.737030 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tv4zb" event={"ID":"ad18bf63-5cb1-49ed-8747-cf53066d4757","Type":"ContainerStarted","Data":"ff96ae647c00866e54a56c5aa222a5586e40bf6d032466362f8eb84012e451af"} Jun 14 15:53:42.788208 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:42.788149 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tv4zb" podStartSLOduration=4.809544847 podStartE2EDuration="23.788134685s" totalImagesPullingTime="18.978589838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:53:42.787621915 +0000 UTC m=+23.717269611" watchObservedRunningTime="2026-06-14 15:53:42.788134685 +0000 UTC m=+23.717782380" Jun 14 15:53:43.570406 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:43.570202 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:43.570406 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:43.570403 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:43.570619 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:43.570502 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgn2" podUID="1413db4b-a032-4c35-85d3-1a8976c37f1b" Jun 14 15:53:43.570619 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:43.570588 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9q49" podUID="07df90f6-3e95-433f-bce9-29fb97c0fb35" Jun 14 15:53:43.570619 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:43.570152 2528 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T15:53:42.723891865Z","UUID":"bff59c59-58c3-4a50-8b83-698c3d07a305","Handler":null,"Name":"","Endpoint":""} Jun 14 15:53:43.570826 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:43.570639 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:43.570826 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:43.570694 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5kjf" podUID="36c343bd-9776-45d6-9fd4-6994edafd550" Jun 14 15:53:43.572346 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:43.572320 2528 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 15:53:43.572496 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:43.572367 2528 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 15:53:43.741964 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:43.741925 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" event={"ID":"2dab904e-fc99-45bb-9362-0df3da6dcdc1","Type":"ContainerStarted","Data":"06cfbbbece655a37bb6a886a750cf742d22801aef5ef109af837e44d78ca852a"} Jun 14 15:53:43.743755 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:43.743728 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-snhpz" event={"ID":"f2e469d0-d655-4bf3-bbb1-d7ef8273bb3e","Type":"ContainerStarted","Data":"272e9a50e35f4002f969de0dcf139164a43cdddc6d7f0356f50ebe26354b724b"} Jun 14 15:53:43.757967 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:43.757911 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4h492" podStartSLOduration=4.095807416 podStartE2EDuration="24.757889194s" totalImagesPullingTime="20.662081778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:53:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:53:43.757318864 +0000 UTC m=+24.686966559" watchObservedRunningTime="2026-06-14 15:53:43.757889194 +0000 UTC m=+24.687536889" Jun 14 15:53:43.769862 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:43.769802 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-snhpz" podStartSLOduration=5.792024194 podStartE2EDuration="24.769785519s" totalImagesPullingTime="18.977761325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:53:43.769434274 +0000 UTC m=+24.699081960" watchObservedRunningTime="2026-06-14 15:53:43.769785519 +0000 UTC m=+24.699433214" Jun 14 15:53:44.750400 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:44.750356 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" event={"ID":"afeb30b4-9a80-4d35-aa77-0074ffb33370","Type":"ContainerStarted","Data":"d4188d69aafed2aba436f9ccd347dbac820d44ac46a3997232ec148e3b61bbf1"} Jun 14 15:53:45.566466 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:45.566426 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:45.566657 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:45.566427 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:45.566657 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:45.566572 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgn2" podUID="1413db4b-a032-4c35-85d3-1a8976c37f1b" Jun 14 15:53:45.566657 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:45.566582 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:45.566780 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:45.566660 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5kjf" podUID="36c343bd-9776-45d6-9fd4-6994edafd550" Jun 14 15:53:45.566780 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:45.566742 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9q49" podUID="07df90f6-3e95-433f-bce9-29fb97c0fb35" Jun 14 15:53:46.594325 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:46.594238 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6jp7n" Jun 14 15:53:46.595098 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:46.595077 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6jp7n" Jun 14 15:53:46.755314 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:46.755279 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6jp7n" Jun 14 15:53:46.755898 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:46.755871 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6jp7n" Jun 14 15:53:47.570274 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:47.570025 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:47.570274 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:47.570072 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:47.570456 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:47.570303 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5kjf" podUID="36c343bd-9776-45d6-9fd4-6994edafd550" Jun 14 15:53:47.570456 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:47.570083 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:47.570456 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:47.570354 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgn2" podUID="1413db4b-a032-4c35-85d3-1a8976c37f1b" Jun 14 15:53:47.570456 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:47.570411 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9q49" podUID="07df90f6-3e95-433f-bce9-29fb97c0fb35" Jun 14 15:53:47.759578 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:47.759544 2528 generic.go:356] "Generic (PLEG): container finished" podID="07d6f6c8-b332-424e-b657-0a6cfe599959" containerID="260142fe2759766f30ec08604e1a0471b6f5affee1904f4e0c11dd9e1a5b9e5a" exitCode=0 Jun 14 15:53:47.760169 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:47.759661 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbxp5" event={"ID":"07d6f6c8-b332-424e-b657-0a6cfe599959","Type":"ContainerDied","Data":"260142fe2759766f30ec08604e1a0471b6f5affee1904f4e0c11dd9e1a5b9e5a"} Jun 14 15:53:47.763538 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:47.763515 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" event={"ID":"afeb30b4-9a80-4d35-aa77-0074ffb33370","Type":"ContainerStarted","Data":"08c9b4bf008e9c831e4398fc47cf70971af3b90a82d2ed483140973a1162ebff"} Jun 14 15:53:47.806888 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:47.806829 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" podStartSLOduration=9.759865905 podStartE2EDuration="28.806809468s" totalImagesPullingTime="19.046943563s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:53:47.80620279 +0000 UTC m=+28.735850487" watchObservedRunningTime="2026-06-14 15:53:47.806809468 +0000 UTC m=+28.736457163" Jun 14 15:53:48.767102 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:48.766883 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:48.767102 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:48.767012 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:48.767102 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:48.767051 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:48.785739 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:48.785709 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:48.786013 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:48.785991 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:53:49.024028 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:49.023945 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t5kjf"] Jun 14 15:53:49.024154 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:49.024081 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:49.024198 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:49.024173 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5kjf" podUID="36c343bd-9776-45d6-9fd4-6994edafd550" Jun 14 15:53:49.027155 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:49.027121 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-frgn2"] Jun 14 15:53:49.027345 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:49.027326 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:49.027474 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:49.027450 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgn2" podUID="1413db4b-a032-4c35-85d3-1a8976c37f1b" Jun 14 15:53:49.027807 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:49.027788 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w9q49"] Jun 14 15:53:49.027898 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:49.027869 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:49.028022 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:49.027959 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9q49" podUID="07df90f6-3e95-433f-bce9-29fb97c0fb35" Jun 14 15:53:49.770296 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:49.770257 2528 generic.go:356] "Generic (PLEG): container finished" podID="07d6f6c8-b332-424e-b657-0a6cfe599959" containerID="c4fde7e8fd6de3f99e2020224120aa9e9a3246f97f6fa09f0cc0233609a286f3" exitCode=0 Jun 14 15:53:49.770688 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:49.770358 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbxp5" event={"ID":"07d6f6c8-b332-424e-b657-0a6cfe599959","Type":"ContainerDied","Data":"c4fde7e8fd6de3f99e2020224120aa9e9a3246f97f6fa09f0cc0233609a286f3"} Jun 14 15:53:50.565941 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:50.565908 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:50.566119 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:50.565953 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:50.566119 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:50.566001 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:50.566119 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:50.566014 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgn2" podUID="1413db4b-a032-4c35-85d3-1a8976c37f1b" Jun 14 15:53:50.566119 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:50.566079 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5kjf" podUID="36c343bd-9776-45d6-9fd4-6994edafd550" Jun 14 15:53:50.566302 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:50.566137 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9q49" podUID="07df90f6-3e95-433f-bce9-29fb97c0fb35" Jun 14 15:53:51.781649 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:51.781610 2528 generic.go:356] "Generic (PLEG): container finished" podID="07d6f6c8-b332-424e-b657-0a6cfe599959" containerID="bf1561eb16953b2e9e61f7c14d1653e4197c0af1d844261e4c1777985f63e1ef" exitCode=0 Jun 14 15:53:51.782258 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:51.781672 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbxp5" event={"ID":"07d6f6c8-b332-424e-b657-0a6cfe599959","Type":"ContainerDied","Data":"bf1561eb16953b2e9e61f7c14d1653e4197c0af1d844261e4c1777985f63e1ef"} Jun 14 15:53:52.566204 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:52.566170 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:52.566432 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:52.566170 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:52.566432 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:52.566286 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-frgn2" podUID="1413db4b-a032-4c35-85d3-1a8976c37f1b" Jun 14 15:53:52.566432 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:52.566312 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:52.566432 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:52.566386 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t5kjf" podUID="36c343bd-9776-45d6-9fd4-6994edafd550" Jun 14 15:53:52.566561 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:52.566440 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w9q49" podUID="07df90f6-3e95-433f-bce9-29fb97c0fb35" Jun 14 15:53:53.267884 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:53.267843 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret\") pod \"global-pull-secret-syncer-w9q49\" (UID: \"07df90f6-3e95-433f-bce9-29fb97c0fb35\") " pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:53.268661 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:53.268020 2528 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 15:53:53.268661 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:53.268102 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret podName:07df90f6-3e95-433f-bce9-29fb97c0fb35 nodeName:}" failed. No retries permitted until 2026-06-14 15:54:25.268080744 +0000 UTC m=+66.197728419 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret") pod "global-pull-secret-syncer-w9q49" (UID: "07df90f6-3e95-433f-bce9-29fb97c0fb35") : object "kube-system"/"original-pull-secret" not registered Jun 14 15:53:53.368559 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:53.368518 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs\") pod \"network-metrics-daemon-t5kjf\" (UID: \"36c343bd-9776-45d6-9fd4-6994edafd550\") " pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:53.368761 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:53.368689 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:53:53.368808 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:53.368770 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs podName:36c343bd-9776-45d6-9fd4-6994edafd550 nodeName:}" failed. No retries permitted until 2026-06-14 15:54:25.368755889 +0000 UTC m=+66.298403562 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs") pod "network-metrics-daemon-t5kjf" (UID: "36c343bd-9776-45d6-9fd4-6994edafd550") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 15:53:53.469415 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:53.469379 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scxcd\" (UniqueName: \"kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd\") pod \"network-check-target-frgn2\" (UID: \"1413db4b-a032-4c35-85d3-1a8976c37f1b\") " pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:53.469647 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:53.469621 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 15:53:53.469702 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:53.469656 2528 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 15:53:53.469702 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:53.469669 2528 projected.go:196] Error preparing data for projected volume kube-api-access-scxcd for pod openshift-network-diagnostics/network-check-target-frgn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:53:53.469802 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:53.469732 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd podName:1413db4b-a032-4c35-85d3-1a8976c37f1b nodeName:}" failed. No retries permitted until 2026-06-14 15:54:25.469714228 +0000 UTC m=+66.399361919 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-scxcd" (UniqueName: "kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd") pod "network-check-target-frgn2" (UID: "1413db4b-a032-4c35-85d3-1a8976c37f1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 15:53:54.390017 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.389767 2528 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-112.ec2.internal" event="NodeReady" Jun 14 15:53:54.390505 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.390163 2528 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 15:53:54.429082 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.428993 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5467bb9bd-rtrsb"] Jun 14 15:53:54.442567 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.442519 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.443444 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.443418 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5467bb9bd-rtrsb"] Jun 14 15:53:54.444093 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.444070 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jb9fb"] Jun 14 15:53:54.444363 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.444339 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 14 15:53:54.444539 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.444515 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 14 15:53:54.445902 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.445092 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 14 15:53:54.445902 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.445795 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sj9hl\"" Jun 14 15:53:54.452537 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.452500 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 14 15:53:54.456399 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.456376 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bpcbr"] Jun 14 15:53:54.456522 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.456496 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jb9fb" Jun 14 15:53:54.458808 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.458782 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 15:53:54.458989 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.458782 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-drg75\"" Jun 14 15:53:54.458989 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.458825 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 15:53:54.470477 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.470445 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jb9fb"] Jun 14 15:53:54.470800 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.470774 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bpcbr" Jun 14 15:53:54.472163 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.472135 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bpcbr"] Jun 14 15:53:54.473336 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.473125 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 15:53:54.473336 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.473145 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 15:53:54.473336 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.473297 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 15:53:54.473531 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.473384 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f724f\"" Jun 14 15:53:54.566670 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.566635 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:53:54.566872 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.566637 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:53:54.566872 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.566822 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:53:54.569260 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.569168 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 15:53:54.569260 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.569185 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 15:53:54.569260 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.569199 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dj4t5\"" Jun 14 15:53:54.569260 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.569251 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 15:53:54.569567 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.569298 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 15:53:54.569567 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.569469 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zjrn2\"" Jun 14 15:53:54.579189 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.579159 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:53:54.579347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.579200 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79a3acdf-c409-4e2d-8e7f-5a3af205008e-ca-trust-extracted\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.579347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.579245 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-bound-sa-token\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.579347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.579282 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.579347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.579304 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-certificates\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.579347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.579328 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79a3acdf-c409-4e2d-8e7f-5a3af205008e-trusted-ca\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.579558 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.579350 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50821ade-1839-41ad-9c07-4b1316d44359-config-volume\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:53:54.579558 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.579471 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79a3acdf-c409-4e2d-8e7f-5a3af205008e-image-registry-private-configuration\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.579558 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.579494 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50821ade-1839-41ad-9c07-4b1316d44359-tmp-dir\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:53:54.579558 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.579515 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79a3acdf-c409-4e2d-8e7f-5a3af205008e-installation-pull-secrets\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.579558 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.579536 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgx66\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-kube-api-access-sgx66\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.579558 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.579557 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28eb3a88-ed18-482b-b2a5-3f43b1991ff5-cert\") pod \"ingress-canary-bpcbr\" (UID: \"28eb3a88-ed18-482b-b2a5-3f43b1991ff5\") " pod="openshift-ingress-canary/ingress-canary-bpcbr" Jun 14 15:53:54.579733 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.579595 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpt8m\" (UniqueName: \"kubernetes.io/projected/28eb3a88-ed18-482b-b2a5-3f43b1991ff5-kube-api-access-mpt8m\") pod \"ingress-canary-bpcbr\" (UID: \"28eb3a88-ed18-482b-b2a5-3f43b1991ff5\") " pod="openshift-ingress-canary/ingress-canary-bpcbr" Jun 14 15:53:54.579733 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.579636 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs28r\" (UniqueName: \"kubernetes.io/projected/50821ade-1839-41ad-9c07-4b1316d44359-kube-api-access-fs28r\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:53:54.680396 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.680281 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:53:54.680396 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.680348 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79a3acdf-c409-4e2d-8e7f-5a3af205008e-ca-trust-extracted\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.680598 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:54.680463 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 15:53:54.680598 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.680527 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-bound-sa-token\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.680598 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:54.680549 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls podName:50821ade-1839-41ad-9c07-4b1316d44359 nodeName:}" failed. No retries permitted until 2026-06-14 15:53:55.18053332 +0000 UTC m=+36.110180997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls") pod "dns-default-jb9fb" (UID: "50821ade-1839-41ad-9c07-4b1316d44359") : secret "dns-default-metrics-tls" not found Jun 14 15:53:54.680598 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.680587 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.680856 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.680616 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-certificates\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.680856 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.680643 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79a3acdf-c409-4e2d-8e7f-5a3af205008e-trusted-ca\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.680856 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.680665 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50821ade-1839-41ad-9c07-4b1316d44359-config-volume\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:53:54.680856 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:54.680699 2528 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 15:53:54.680856 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:54.680719 2528 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5467bb9bd-rtrsb: secret "image-registry-tls" not found Jun 14 15:53:54.680856 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.680752 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79a3acdf-c409-4e2d-8e7f-5a3af205008e-ca-trust-extracted\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.680856 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.680763 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79a3acdf-c409-4e2d-8e7f-5a3af205008e-image-registry-private-configuration\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.680856 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:54.680786 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls podName:79a3acdf-c409-4e2d-8e7f-5a3af205008e nodeName:}" failed. No retries permitted until 2026-06-14 15:53:55.18076675 +0000 UTC m=+36.110414425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls") pod "image-registry-5467bb9bd-rtrsb" (UID: "79a3acdf-c409-4e2d-8e7f-5a3af205008e") : secret "image-registry-tls" not found Jun 14 15:53:54.680856 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.680828 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50821ade-1839-41ad-9c07-4b1316d44359-tmp-dir\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:53:54.681301 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.680866 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79a3acdf-c409-4e2d-8e7f-5a3af205008e-installation-pull-secrets\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.681301 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.680902 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgx66\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-kube-api-access-sgx66\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.681301 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.680927 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28eb3a88-ed18-482b-b2a5-3f43b1991ff5-cert\") pod \"ingress-canary-bpcbr\" (UID: \"28eb3a88-ed18-482b-b2a5-3f43b1991ff5\") " pod="openshift-ingress-canary/ingress-canary-bpcbr" Jun 14 15:53:54.681301 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.680959 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpt8m\" (UniqueName: \"kubernetes.io/projected/28eb3a88-ed18-482b-b2a5-3f43b1991ff5-kube-api-access-mpt8m\") pod \"ingress-canary-bpcbr\" (UID: \"28eb3a88-ed18-482b-b2a5-3f43b1991ff5\") " pod="openshift-ingress-canary/ingress-canary-bpcbr" Jun 14 15:53:54.681301 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.680990 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs28r\" (UniqueName: \"kubernetes.io/projected/50821ade-1839-41ad-9c07-4b1316d44359-kube-api-access-fs28r\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:53:54.681542 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.681353 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-certificates\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.681743 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.681717 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50821ade-1839-41ad-9c07-4b1316d44359-tmp-dir\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:53:54.681826 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.681765 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79a3acdf-c409-4e2d-8e7f-5a3af205008e-trusted-ca\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.681974 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.681952 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/50821ade-1839-41ad-9c07-4b1316d44359-config-volume\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:53:54.687332 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.687301 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79a3acdf-c409-4e2d-8e7f-5a3af205008e-installation-pull-secrets\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.687332 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.687319 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79a3acdf-c409-4e2d-8e7f-5a3af205008e-image-registry-private-configuration\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.687332 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.687328 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28eb3a88-ed18-482b-b2a5-3f43b1991ff5-cert\") pod \"ingress-canary-bpcbr\" (UID: \"28eb3a88-ed18-482b-b2a5-3f43b1991ff5\") " pod="openshift-ingress-canary/ingress-canary-bpcbr" Jun 14 15:53:54.695070 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.695022 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpt8m\" (UniqueName: \"kubernetes.io/projected/28eb3a88-ed18-482b-b2a5-3f43b1991ff5-kube-api-access-mpt8m\") pod \"ingress-canary-bpcbr\" (UID: \"28eb3a88-ed18-482b-b2a5-3f43b1991ff5\") " pod="openshift-ingress-canary/ingress-canary-bpcbr" Jun 14 15:53:54.695194 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.695133 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs28r\" (UniqueName: \"kubernetes.io/projected/50821ade-1839-41ad-9c07-4b1316d44359-kube-api-access-fs28r\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:53:54.695194 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.695144 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-bound-sa-token\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.695633 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.695610 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgx66\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-kube-api-access-sgx66\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:54.782581 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:54.782536 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bpcbr" Jun 14 15:53:55.184513 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:55.184466 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:55.184702 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:55.184621 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:53:55.184702 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:55.184637 2528 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 15:53:55.184702 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:55.184661 2528 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5467bb9bd-rtrsb: secret "image-registry-tls" not found Jun 14 15:53:55.184824 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:55.184733 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls podName:79a3acdf-c409-4e2d-8e7f-5a3af205008e nodeName:}" failed. No retries permitted until 2026-06-14 15:53:56.184716877 +0000 UTC m=+37.114364554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls") pod "image-registry-5467bb9bd-rtrsb" (UID: "79a3acdf-c409-4e2d-8e7f-5a3af205008e") : secret "image-registry-tls" not found Jun 14 15:53:55.184824 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:55.184733 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 15:53:55.184824 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:55.184778 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls podName:50821ade-1839-41ad-9c07-4b1316d44359 nodeName:}" failed. No retries permitted until 2026-06-14 15:53:56.184764222 +0000 UTC m=+37.114411898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls") pod "dns-default-jb9fb" (UID: "50821ade-1839-41ad-9c07-4b1316d44359") : secret "dns-default-metrics-tls" not found Jun 14 15:53:56.193401 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:56.193361 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:53:56.193898 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:56.193410 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:56.193898 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:56.193545 2528 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 15:53:56.193898 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:56.193557 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 15:53:56.193898 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:56.193645 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls podName:50821ade-1839-41ad-9c07-4b1316d44359 nodeName:}" failed. No retries permitted until 2026-06-14 15:53:58.193624473 +0000 UTC m=+39.123272170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls") pod "dns-default-jb9fb" (UID: "50821ade-1839-41ad-9c07-4b1316d44359") : secret "dns-default-metrics-tls" not found Jun 14 15:53:56.193898 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:56.193570 2528 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5467bb9bd-rtrsb: secret "image-registry-tls" not found Jun 14 15:53:56.193898 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:56.193717 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls podName:79a3acdf-c409-4e2d-8e7f-5a3af205008e nodeName:}" failed. No retries permitted until 2026-06-14 15:53:58.193704347 +0000 UTC m=+39.123352024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls") pod "image-registry-5467bb9bd-rtrsb" (UID: "79a3acdf-c409-4e2d-8e7f-5a3af205008e") : secret "image-registry-tls" not found Jun 14 15:53:56.384342 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:56.384299 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bpcbr"] Jun 14 15:53:56.446069 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:53:56.445997 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28eb3a88_ed18_482b_b2a5_3f43b1991ff5.slice/crio-9252d554824d227097f4784de57d5ef60e34bccd80866c5727942d132faf371a WatchSource:0}: Error finding container 9252d554824d227097f4784de57d5ef60e34bccd80866c5727942d132faf371a: Status 404 returned error can't find the container with id 9252d554824d227097f4784de57d5ef60e34bccd80866c5727942d132faf371a Jun 14 15:53:56.797763 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:56.797730 2528 generic.go:356] "Generic (PLEG): container finished" podID="07d6f6c8-b332-424e-b657-0a6cfe599959" containerID="ae02fbfdfe7b8b3ccf627bd1076633dcf27ab78d12046ac97a2f9e61c9147457" exitCode=0 Jun 14 15:53:56.797936 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:56.797814 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbxp5" event={"ID":"07d6f6c8-b332-424e-b657-0a6cfe599959","Type":"ContainerDied","Data":"ae02fbfdfe7b8b3ccf627bd1076633dcf27ab78d12046ac97a2f9e61c9147457"} Jun 14 15:53:56.799085 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:56.799057 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bpcbr" event={"ID":"28eb3a88-ed18-482b-b2a5-3f43b1991ff5","Type":"ContainerStarted","Data":"9252d554824d227097f4784de57d5ef60e34bccd80866c5727942d132faf371a"} Jun 14 15:53:57.805914 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:57.805879 2528 generic.go:356] "Generic (PLEG): container finished" podID="07d6f6c8-b332-424e-b657-0a6cfe599959" containerID="c82ef93006e500774e4a5babea35f1025b9cba3f2426df7f1acb102ca0c107c6" exitCode=0 Jun 14 15:53:57.806379 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:57.805960 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbxp5" event={"ID":"07d6f6c8-b332-424e-b657-0a6cfe599959","Type":"ContainerDied","Data":"c82ef93006e500774e4a5babea35f1025b9cba3f2426df7f1acb102ca0c107c6"} Jun 14 15:53:58.209274 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:58.209248 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:53:58.209400 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:58.209288 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:53:58.209400 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:58.209385 2528 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 15:53:58.209400 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:58.209395 2528 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5467bb9bd-rtrsb: secret "image-registry-tls" not found Jun 14 15:53:58.209517 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:58.209396 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 15:53:58.209517 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:58.209445 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls podName:79a3acdf-c409-4e2d-8e7f-5a3af205008e nodeName:}" failed. No retries permitted until 2026-06-14 15:54:02.209433052 +0000 UTC m=+43.139080729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls") pod "image-registry-5467bb9bd-rtrsb" (UID: "79a3acdf-c409-4e2d-8e7f-5a3af205008e") : secret "image-registry-tls" not found Jun 14 15:53:58.209517 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:53:58.209458 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls podName:50821ade-1839-41ad-9c07-4b1316d44359 nodeName:}" failed. No retries permitted until 2026-06-14 15:54:02.209452362 +0000 UTC m=+43.139100035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls") pod "dns-default-jb9fb" (UID: "50821ade-1839-41ad-9c07-4b1316d44359") : secret "dns-default-metrics-tls" not found Jun 14 15:53:58.810245 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:58.810140 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bpcbr" event={"ID":"28eb3a88-ed18-482b-b2a5-3f43b1991ff5","Type":"ContainerStarted","Data":"5fd80d81c003968fc873574567746605efb16e6e266b198b4458d2c2279e7c66"} Jun 14 15:53:58.813610 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:58.813579 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbxp5" event={"ID":"07d6f6c8-b332-424e-b657-0a6cfe599959","Type":"ContainerStarted","Data":"ddfa397c5cdda8575c15069e2dcdf351e4939fe7c964eadc4ab7fd56da3bc00a"} Jun 14 15:53:58.824256 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:58.824183 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bpcbr" podStartSLOduration=2.956582509 podStartE2EDuration="4.824167701s" totalImagesPullingTime="1.867585192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:53:58.823753751 +0000 UTC m=+39.753401447" watchObservedRunningTime="2026-06-14 15:53:58.824167701 +0000 UTC m=+39.753815396" Jun 14 15:53:58.843443 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:53:58.843384 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rbxp5" podStartSLOduration=9.667090231 podStartE2EDuration="39.843365178s" totalImagesPullingTime="30.176274947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:53:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:53:58.842683967 +0000 UTC m=+39.772331662" watchObservedRunningTime="2026-06-14 15:53:58.843365178 +0000 UTC m=+39.773012874" Jun 14 15:54:02.240771 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:02.240730 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:54:02.241258 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:02.240842 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:54:02.241258 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:02.240885 2528 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 15:54:02.241258 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:02.240908 2528 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5467bb9bd-rtrsb: secret "image-registry-tls" not found Jun 14 15:54:02.241258 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:02.240929 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 15:54:02.241258 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:02.240966 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls podName:79a3acdf-c409-4e2d-8e7f-5a3af205008e nodeName:}" failed. No retries permitted until 2026-06-14 15:54:10.240950301 +0000 UTC m=+51.170597992 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls") pod "image-registry-5467bb9bd-rtrsb" (UID: "79a3acdf-c409-4e2d-8e7f-5a3af205008e") : secret "image-registry-tls" not found Jun 14 15:54:02.241258 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:02.240980 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls podName:50821ade-1839-41ad-9c07-4b1316d44359 nodeName:}" failed. No retries permitted until 2026-06-14 15:54:10.240975011 +0000 UTC m=+51.170622684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls") pod "dns-default-jb9fb" (UID: "50821ade-1839-41ad-9c07-4b1316d44359") : secret "dns-default-metrics-tls" not found Jun 14 15:54:10.303562 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:10.303520 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:54:10.303562 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:10.303566 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:54:10.304121 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:10.303666 2528 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 15:54:10.304121 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:10.303677 2528 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5467bb9bd-rtrsb: secret "image-registry-tls" not found Jun 14 15:54:10.304121 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:10.303677 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 15:54:10.304121 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:10.303732 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls podName:79a3acdf-c409-4e2d-8e7f-5a3af205008e nodeName:}" failed. No retries permitted until 2026-06-14 15:54:26.303717463 +0000 UTC m=+67.233365136 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls") pod "image-registry-5467bb9bd-rtrsb" (UID: "79a3acdf-c409-4e2d-8e7f-5a3af205008e") : secret "image-registry-tls" not found Jun 14 15:54:10.304121 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:10.303745 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls podName:50821ade-1839-41ad-9c07-4b1316d44359 nodeName:}" failed. No retries permitted until 2026-06-14 15:54:26.303739905 +0000 UTC m=+67.233387579 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls") pod "dns-default-jb9fb" (UID: "50821ade-1839-41ad-9c07-4b1316d44359") : secret "dns-default-metrics-tls" not found Jun 14 15:54:20.785163 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:20.785134 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mqv4x" Jun 14 15:54:25.317668 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:25.317623 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret\") pod \"global-pull-secret-syncer-w9q49\" (UID: \"07df90f6-3e95-433f-bce9-29fb97c0fb35\") " pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:54:25.319763 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:25.319742 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 15:54:25.331845 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:25.331813 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07df90f6-3e95-433f-bce9-29fb97c0fb35-original-pull-secret\") pod \"global-pull-secret-syncer-w9q49\" (UID: \"07df90f6-3e95-433f-bce9-29fb97c0fb35\") " pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:54:25.418729 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:25.418684 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs\") pod \"network-metrics-daemon-t5kjf\" (UID: \"36c343bd-9776-45d6-9fd4-6994edafd550\") " pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:54:25.420827 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:25.420808 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 15:54:25.429616 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:25.429572 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 15:54:25.429688 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:25.429671 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs podName:36c343bd-9776-45d6-9fd4-6994edafd550 nodeName:}" failed. No retries permitted until 2026-06-14 15:55:29.429653476 +0000 UTC m=+130.359301149 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs") pod "network-metrics-daemon-t5kjf" (UID: "36c343bd-9776-45d6-9fd4-6994edafd550") : secret "metrics-daemon-secret" not found Jun 14 15:54:25.489091 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:25.489046 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w9q49" Jun 14 15:54:25.519631 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:25.519589 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scxcd\" (UniqueName: \"kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd\") pod \"network-check-target-frgn2\" (UID: \"1413db4b-a032-4c35-85d3-1a8976c37f1b\") " pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:54:25.521867 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:25.521846 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 15:54:25.532814 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:25.532784 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 15:54:25.544016 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:25.543988 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scxcd\" (UniqueName: \"kubernetes.io/projected/1413db4b-a032-4c35-85d3-1a8976c37f1b-kube-api-access-scxcd\") pod \"network-check-target-frgn2\" (UID: \"1413db4b-a032-4c35-85d3-1a8976c37f1b\") " pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:54:25.640087 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:25.640051 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w9q49"] Jun 14 15:54:25.643481 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:54:25.643442 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07df90f6_3e95_433f_bce9_29fb97c0fb35.slice/crio-6566731ceda6e1e047b4d0ffc0ff589254d61a93ce86769769dff4676f1cef46 WatchSource:0}: Error finding container 6566731ceda6e1e047b4d0ffc0ff589254d61a93ce86769769dff4676f1cef46: Status 404 returned error can't find the container with id 6566731ceda6e1e047b4d0ffc0ff589254d61a93ce86769769dff4676f1cef46 Jun 14 15:54:25.785483 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:25.785449 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dj4t5\"" Jun 14 15:54:25.793589 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:25.793558 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:54:25.879969 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:25.879934 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w9q49" event={"ID":"07df90f6-3e95-433f-bce9-29fb97c0fb35","Type":"ContainerStarted","Data":"6566731ceda6e1e047b4d0ffc0ff589254d61a93ce86769769dff4676f1cef46"} Jun 14 15:54:25.920872 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:25.920839 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-frgn2"] Jun 14 15:54:25.924124 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:54:25.924093 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1413db4b_a032_4c35_85d3_1a8976c37f1b.slice/crio-59b8b4272505aba0131a5bc0d68960e12d351ed0ad37795d1d3a7ab57c6c2e62 WatchSource:0}: Error finding container 59b8b4272505aba0131a5bc0d68960e12d351ed0ad37795d1d3a7ab57c6c2e62: Status 404 returned error can't find the container with id 59b8b4272505aba0131a5bc0d68960e12d351ed0ad37795d1d3a7ab57c6c2e62 Jun 14 15:54:26.325436 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:26.325403 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:54:26.325436 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:26.325443 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:54:26.325923 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:26.325561 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 15:54:26.325923 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:26.325564 2528 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 15:54:26.325923 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:26.325584 2528 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5467bb9bd-rtrsb: secret "image-registry-tls" not found Jun 14 15:54:26.325923 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:26.325643 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls podName:79a3acdf-c409-4e2d-8e7f-5a3af205008e nodeName:}" failed. No retries permitted until 2026-06-14 15:54:58.325618732 +0000 UTC m=+99.255266426 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls") pod "image-registry-5467bb9bd-rtrsb" (UID: "79a3acdf-c409-4e2d-8e7f-5a3af205008e") : secret "image-registry-tls" not found Jun 14 15:54:26.325923 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:26.325661 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls podName:50821ade-1839-41ad-9c07-4b1316d44359 nodeName:}" failed. No retries permitted until 2026-06-14 15:54:58.325648747 +0000 UTC m=+99.255296420 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls") pod "dns-default-jb9fb" (UID: "50821ade-1839-41ad-9c07-4b1316d44359") : secret "dns-default-metrics-tls" not found Jun 14 15:54:26.884820 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:26.884746 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-frgn2" event={"ID":"1413db4b-a032-4c35-85d3-1a8976c37f1b","Type":"ContainerStarted","Data":"59b8b4272505aba0131a5bc0d68960e12d351ed0ad37795d1d3a7ab57c6c2e62"} Jun 14 15:54:30.897819 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:30.897777 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w9q49" event={"ID":"07df90f6-3e95-433f-bce9-29fb97c0fb35","Type":"ContainerStarted","Data":"074dbf8ea641627b76a7fab11265def8e6710734de6742c64b9737a5371908ec"} Jun 14 15:54:30.899243 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:30.899194 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-frgn2" event={"ID":"1413db4b-a032-4c35-85d3-1a8976c37f1b","Type":"ContainerStarted","Data":"c0cdb6a876bb1119aa8bc3aa10c9ed8fad4c06c97357c9aa61a086622072e099"} Jun 14 15:54:30.899383 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:30.899273 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:54:30.913671 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:30.913613 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w9q49" podStartSLOduration=67.306679512 podStartE2EDuration="1m11.913596444s" totalImagesPullingTime="4.606916932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:54:30.912827582 +0000 UTC m=+71.842475276" watchObservedRunningTime="2026-06-14 15:54:30.913596444 +0000 UTC m=+71.843244139" Jun 14 15:54:30.927440 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:30.927381 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-frgn2" podStartSLOduration=67.607000693 podStartE2EDuration="1m11.92736238s" totalImagesPullingTime="4.320361687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:54:30.926644599 +0000 UTC m=+71.856292294" watchObservedRunningTime="2026-06-14 15:54:30.92736238 +0000 UTC m=+71.857010053" Jun 14 15:54:58.359711 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:58.359568 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:54:58.359711 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:54:58.359625 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:54:58.360262 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:58.359729 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 15:54:58.360262 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:58.359802 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls podName:50821ade-1839-41ad-9c07-4b1316d44359 nodeName:}" failed. No retries permitted until 2026-06-14 15:56:02.359785962 +0000 UTC m=+163.289433647 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls") pod "dns-default-jb9fb" (UID: "50821ade-1839-41ad-9c07-4b1316d44359") : secret "dns-default-metrics-tls" not found Jun 14 15:54:58.360262 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:58.359731 2528 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 15:54:58.360262 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:58.359828 2528 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5467bb9bd-rtrsb: secret "image-registry-tls" not found Jun 14 15:54:58.360262 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:54:58.359879 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls podName:79a3acdf-c409-4e2d-8e7f-5a3af205008e nodeName:}" failed. No retries permitted until 2026-06-14 15:56:02.359866578 +0000 UTC m=+163.289514252 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls") pod "image-registry-5467bb9bd-rtrsb" (UID: "79a3acdf-c409-4e2d-8e7f-5a3af205008e") : secret "image-registry-tls" not found Jun 14 15:55:01.903522 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:55:01.903491 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-frgn2" Jun 14 15:55:29.484385 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:55:29.484337 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs\") pod \"network-metrics-daemon-t5kjf\" (UID: \"36c343bd-9776-45d6-9fd4-6994edafd550\") " pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:55:29.484978 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:55:29.484521 2528 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 15:55:29.484978 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:55:29.484617 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs podName:36c343bd-9776-45d6-9fd4-6994edafd550 nodeName:}" failed. No retries permitted until 2026-06-14 15:57:31.484593902 +0000 UTC m=+252.414241596 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs") pod "network-metrics-daemon-t5kjf" (UID: "36c343bd-9776-45d6-9fd4-6994edafd550") : secret "metrics-daemon-secret" not found Jun 14 15:55:57.456335 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:55:57.456282 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" podUID="79a3acdf-c409-4e2d-8e7f-5a3af205008e" Jun 14 15:55:57.466635 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:55:57.466586 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jb9fb" podUID="50821ade-1839-41ad-9c07-4b1316d44359" Jun 14 15:55:57.577402 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:55:57.577357 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-t5kjf" podUID="36c343bd-9776-45d6-9fd4-6994edafd550" Jun 14 15:55:58.115050 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:55:58.115019 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:55:58.115050 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:55:58.115053 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jb9fb" Jun 14 15:56:02.418823 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:56:02.418777 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:56:02.418823 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:56:02.418827 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:56:02.419360 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:56:02.418936 2528 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 15:56:02.419360 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:56:02.418947 2528 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5467bb9bd-rtrsb: secret "image-registry-tls" not found Jun 14 15:56:02.419360 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:56:02.418948 2528 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 15:56:02.419360 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:56:02.418998 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls podName:79a3acdf-c409-4e2d-8e7f-5a3af205008e nodeName:}" failed. No retries permitted until 2026-06-14 15:58:04.418985138 +0000 UTC m=+285.348632811 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls") pod "image-registry-5467bb9bd-rtrsb" (UID: "79a3acdf-c409-4e2d-8e7f-5a3af205008e") : secret "image-registry-tls" not found Jun 14 15:56:02.419360 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:56:02.419022 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls podName:50821ade-1839-41ad-9c07-4b1316d44359 nodeName:}" failed. No retries permitted until 2026-06-14 15:58:04.41900246 +0000 UTC m=+285.348650146 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls") pod "dns-default-jb9fb" (UID: "50821ade-1839-41ad-9c07-4b1316d44359") : secret "dns-default-metrics-tls" not found Jun 14 15:56:10.567025 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:56:10.566920 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:57:12.552034 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.551999 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v"] Jun 14 15:57:12.554867 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.554841 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz"] Jun 14 15:57:12.555013 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.554959 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" Jun 14 15:57:12.557518 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.557492 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-b5tmd"] Jun 14 15:57:12.557731 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.557711 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz" Jun 14 15:57:12.558673 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.558641 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 15:57:12.558673 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.558645 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 15:57:12.558843 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.558711 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 14 15:57:12.558843 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.558776 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 14 15:57:12.558961 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.558945 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-25447\"" Jun 14 15:57:12.560368 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.560351 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kcdnc"] Jun 14 15:57:12.560495 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.560478 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" Jun 14 15:57:12.560902 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.560726 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 14 15:57:12.561030 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.560956 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 14 15:57:12.561030 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.561010 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-kn7sg\"" Jun 14 15:57:12.561437 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.561421 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 14 15:57:12.563272 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.563254 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kcdnc" Jun 14 15:57:12.564267 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.564245 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 14 15:57:12.564363 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.564248 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 14 15:57:12.564363 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.564299 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 14 15:57:12.576424 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.576401 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 14 15:57:12.589257 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.589208 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 14 15:57:12.589439 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.589307 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 14 15:57:12.589439 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.589332 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nph8q\"" Jun 14 15:57:12.589548 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.589493 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz"] Jun 14 15:57:12.589630 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.589614 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-x5s4d\"" Jun 14 15:57:12.591028 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.591005 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v"] Jun 14 15:57:12.592226 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.592192 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kcdnc"] Jun 14 15:57:12.592860 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.592843 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 14 15:57:12.597497 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.597475 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-b5tmd"] Jun 14 15:57:12.605402 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.605378 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 14 15:57:12.618335 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.618302 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ba7e3f8c-371f-448a-939c-3d88290bbeda-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-nhxvz\" (UID: \"ba7e3f8c-371f-448a-939c-3d88290bbeda\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz" Jun 14 15:57:12.618472 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.618346 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba7e3f8c-371f-448a-939c-3d88290bbeda-config\") pod \"service-ca-operator-7ccbfd59dc-nhxvz\" (UID: \"ba7e3f8c-371f-448a-939c-3d88290bbeda\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz" Jun 14 15:57:12.618472 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.618380 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-wm26v\" (UID: \"0cb84e67-7dda-4d59-9e09-56e18da9d6a9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" Jun 14 15:57:12.618578 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.618477 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qq8v\" (UniqueName: \"kubernetes.io/projected/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-kube-api-access-9qq8v\") pod \"cluster-monitoring-operator-f9d7df769-wm26v\" (UID: \"0cb84e67-7dda-4d59-9e09-56e18da9d6a9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" Jun 14 15:57:12.618578 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.618551 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq75j\" (UniqueName: \"kubernetes.io/projected/ba7e3f8c-371f-448a-939c-3d88290bbeda-kube-api-access-tq75j\") pod \"service-ca-operator-7ccbfd59dc-nhxvz\" (UID: \"ba7e3f8c-371f-448a-939c-3d88290bbeda\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz" Jun 14 15:57:12.618661 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.618586 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-wm26v\" (UID: \"0cb84e67-7dda-4d59-9e09-56e18da9d6a9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" Jun 14 15:57:12.666233 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.666182 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6"] Jun 14 15:57:12.669126 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.669106 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-hsvlk"] Jun 14 15:57:12.669283 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.669266 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6" Jun 14 15:57:12.672046 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.672019 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.672591 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.672563 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 14 15:57:12.672694 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.672616 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 14 15:57:12.672738 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.672688 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8pfbb\"" Jun 14 15:57:12.672851 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.672835 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 14 15:57:12.674652 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.674629 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 14 15:57:12.675876 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.675857 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 14 15:57:12.676990 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.676969 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 15:57:12.677116 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.676988 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 14 15:57:12.677116 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.677087 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-s9w45\"" Jun 14 15:57:12.677419 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.677394 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 15:57:12.684172 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.684150 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 14 15:57:12.686175 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.686146 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6"] Jun 14 15:57:12.691762 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.691737 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-hsvlk"] Jun 14 15:57:12.719380 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.719341 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-wm26v\" (UID: \"0cb84e67-7dda-4d59-9e09-56e18da9d6a9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" Jun 14 15:57:12.719380 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.719384 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d44k6\" (UniqueName: \"kubernetes.io/projected/80523acb-bab6-4e11-83b3-35af2852be80-kube-api-access-d44k6\") pod \"console-operator-5dbbb5d744-b5tmd\" (UID: \"80523acb-bab6-4e11-83b3-35af2852be80\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" Jun 14 15:57:12.719649 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.719407 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85svb\" (UniqueName: \"kubernetes.io/projected/833c74ce-b24b-426b-b7ec-566319790322-kube-api-access-85svb\") pod \"volume-data-source-validator-bd4ccd799-kcdnc\" (UID: \"833c74ce-b24b-426b-b7ec-566319790322\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kcdnc" Jun 14 15:57:12.719649 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.719437 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qq8v\" (UniqueName: \"kubernetes.io/projected/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-kube-api-access-9qq8v\") pod \"cluster-monitoring-operator-f9d7df769-wm26v\" (UID: \"0cb84e67-7dda-4d59-9e09-56e18da9d6a9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" Jun 14 15:57:12.719649 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.719508 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq75j\" (UniqueName: \"kubernetes.io/projected/ba7e3f8c-371f-448a-939c-3d88290bbeda-kube-api-access-tq75j\") pod \"service-ca-operator-7ccbfd59dc-nhxvz\" (UID: \"ba7e3f8c-371f-448a-939c-3d88290bbeda\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz" Jun 14 15:57:12.719649 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.719548 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80523acb-bab6-4e11-83b3-35af2852be80-serving-cert\") pod \"console-operator-5dbbb5d744-b5tmd\" (UID: \"80523acb-bab6-4e11-83b3-35af2852be80\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" Jun 14 15:57:12.719649 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.719580 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-wm26v\" (UID: \"0cb84e67-7dda-4d59-9e09-56e18da9d6a9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" Jun 14 15:57:12.719897 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.719685 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ba7e3f8c-371f-448a-939c-3d88290bbeda-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-nhxvz\" (UID: \"ba7e3f8c-371f-448a-939c-3d88290bbeda\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz" Jun 14 15:57:12.719897 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:12.719725 2528 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 15:57:12.719897 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:12.719789 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls podName:0cb84e67-7dda-4d59-9e09-56e18da9d6a9 nodeName:}" failed. No retries permitted until 2026-06-14 15:57:13.219775286 +0000 UTC m=+234.149422960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-wm26v" (UID: "0cb84e67-7dda-4d59-9e09-56e18da9d6a9") : secret "cluster-monitoring-operator-tls" not found Jun 14 15:57:12.719897 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.719724 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80523acb-bab6-4e11-83b3-35af2852be80-config\") pod \"console-operator-5dbbb5d744-b5tmd\" (UID: \"80523acb-bab6-4e11-83b3-35af2852be80\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" Jun 14 15:57:12.719897 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.719848 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80523acb-bab6-4e11-83b3-35af2852be80-trusted-ca\") pod \"console-operator-5dbbb5d744-b5tmd\" (UID: \"80523acb-bab6-4e11-83b3-35af2852be80\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" Jun 14 15:57:12.720158 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.719897 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba7e3f8c-371f-448a-939c-3d88290bbeda-config\") pod \"service-ca-operator-7ccbfd59dc-nhxvz\" (UID: \"ba7e3f8c-371f-448a-939c-3d88290bbeda\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz" Jun 14 15:57:12.720268 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.720247 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-wm26v\" (UID: \"0cb84e67-7dda-4d59-9e09-56e18da9d6a9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" Jun 14 15:57:12.720438 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.720420 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba7e3f8c-371f-448a-939c-3d88290bbeda-config\") pod \"service-ca-operator-7ccbfd59dc-nhxvz\" (UID: \"ba7e3f8c-371f-448a-939c-3d88290bbeda\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz" Jun 14 15:57:12.722298 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.722274 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ba7e3f8c-371f-448a-939c-3d88290bbeda-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-nhxvz\" (UID: \"ba7e3f8c-371f-448a-939c-3d88290bbeda\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz" Jun 14 15:57:12.731553 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.731516 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq75j\" (UniqueName: \"kubernetes.io/projected/ba7e3f8c-371f-448a-939c-3d88290bbeda-kube-api-access-tq75j\") pod \"service-ca-operator-7ccbfd59dc-nhxvz\" (UID: \"ba7e3f8c-371f-448a-939c-3d88290bbeda\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz" Jun 14 15:57:12.731723 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.731647 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qq8v\" (UniqueName: \"kubernetes.io/projected/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-kube-api-access-9qq8v\") pod \"cluster-monitoring-operator-f9d7df769-wm26v\" (UID: \"0cb84e67-7dda-4d59-9e09-56e18da9d6a9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" Jun 14 15:57:12.820669 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.820567 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26897061-21eb-4b9e-a798-f8d22f6005a5-tmp\") pod \"insights-operator-5bbd86d6bd-hsvlk\" (UID: \"26897061-21eb-4b9e-a798-f8d22f6005a5\") " pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.820669 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.820611 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80523acb-bab6-4e11-83b3-35af2852be80-config\") pod \"console-operator-5dbbb5d744-b5tmd\" (UID: \"80523acb-bab6-4e11-83b3-35af2852be80\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" Jun 14 15:57:12.820669 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.820635 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26897061-21eb-4b9e-a798-f8d22f6005a5-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-hsvlk\" (UID: \"26897061-21eb-4b9e-a798-f8d22f6005a5\") " pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.820669 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.820653 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80523acb-bab6-4e11-83b3-35af2852be80-trusted-ca\") pod \"console-operator-5dbbb5d744-b5tmd\" (UID: \"80523acb-bab6-4e11-83b3-35af2852be80\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" Jun 14 15:57:12.820931 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.820727 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/26897061-21eb-4b9e-a798-f8d22f6005a5-snapshots\") pod \"insights-operator-5bbd86d6bd-hsvlk\" (UID: \"26897061-21eb-4b9e-a798-f8d22f6005a5\") " pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.820931 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.820762 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80523acb-bab6-4e11-83b3-35af2852be80-serving-cert\") pod \"console-operator-5dbbb5d744-b5tmd\" (UID: \"80523acb-bab6-4e11-83b3-35af2852be80\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" Jun 14 15:57:12.820931 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.820780 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26897061-21eb-4b9e-a798-f8d22f6005a5-serving-cert\") pod \"insights-operator-5bbd86d6bd-hsvlk\" (UID: \"26897061-21eb-4b9e-a798-f8d22f6005a5\") " pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.820931 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.820857 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ecd58d5a-c77a-4130-9a10-b8869428bf6d-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5v2h6\" (UID: \"ecd58d5a-c77a-4130-9a10-b8869428bf6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6" Jun 14 15:57:12.820931 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.820887 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26897061-21eb-4b9e-a798-f8d22f6005a5-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-hsvlk\" (UID: \"26897061-21eb-4b9e-a798-f8d22f6005a5\") " pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.821148 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.820947 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnpgd\" (UniqueName: \"kubernetes.io/projected/ecd58d5a-c77a-4130-9a10-b8869428bf6d-kube-api-access-qnpgd\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5v2h6\" (UID: \"ecd58d5a-c77a-4130-9a10-b8869428bf6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6" Jun 14 15:57:12.821148 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.821002 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d44k6\" (UniqueName: \"kubernetes.io/projected/80523acb-bab6-4e11-83b3-35af2852be80-kube-api-access-d44k6\") pod \"console-operator-5dbbb5d744-b5tmd\" (UID: \"80523acb-bab6-4e11-83b3-35af2852be80\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" Jun 14 15:57:12.821148 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.821039 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85svb\" (UniqueName: \"kubernetes.io/projected/833c74ce-b24b-426b-b7ec-566319790322-kube-api-access-85svb\") pod \"volume-data-source-validator-bd4ccd799-kcdnc\" (UID: \"833c74ce-b24b-426b-b7ec-566319790322\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kcdnc" Jun 14 15:57:12.821148 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.821079 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs8vk\" (UniqueName: \"kubernetes.io/projected/26897061-21eb-4b9e-a798-f8d22f6005a5-kube-api-access-rs8vk\") pod \"insights-operator-5bbd86d6bd-hsvlk\" (UID: \"26897061-21eb-4b9e-a798-f8d22f6005a5\") " pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.821148 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.821105 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecd58d5a-c77a-4130-9a10-b8869428bf6d-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5v2h6\" (UID: \"ecd58d5a-c77a-4130-9a10-b8869428bf6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6" Jun 14 15:57:12.821425 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.821402 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80523acb-bab6-4e11-83b3-35af2852be80-config\") pod \"console-operator-5dbbb5d744-b5tmd\" (UID: \"80523acb-bab6-4e11-83b3-35af2852be80\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" Jun 14 15:57:12.821540 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.821523 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80523acb-bab6-4e11-83b3-35af2852be80-trusted-ca\") pod \"console-operator-5dbbb5d744-b5tmd\" (UID: \"80523acb-bab6-4e11-83b3-35af2852be80\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" Jun 14 15:57:12.823206 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.823186 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80523acb-bab6-4e11-83b3-35af2852be80-serving-cert\") pod \"console-operator-5dbbb5d744-b5tmd\" (UID: \"80523acb-bab6-4e11-83b3-35af2852be80\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" Jun 14 15:57:12.829841 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.829806 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d44k6\" (UniqueName: \"kubernetes.io/projected/80523acb-bab6-4e11-83b3-35af2852be80-kube-api-access-d44k6\") pod \"console-operator-5dbbb5d744-b5tmd\" (UID: \"80523acb-bab6-4e11-83b3-35af2852be80\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" Jun 14 15:57:12.829999 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.829814 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85svb\" (UniqueName: \"kubernetes.io/projected/833c74ce-b24b-426b-b7ec-566319790322-kube-api-access-85svb\") pod \"volume-data-source-validator-bd4ccd799-kcdnc\" (UID: \"833c74ce-b24b-426b-b7ec-566319790322\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kcdnc" Jun 14 15:57:12.871959 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.871915 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz" Jun 14 15:57:12.878285 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.878258 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" Jun 14 15:57:12.883262 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.883244 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kcdnc" Jun 14 15:57:12.922453 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.922418 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26897061-21eb-4b9e-a798-f8d22f6005a5-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-hsvlk\" (UID: \"26897061-21eb-4b9e-a798-f8d22f6005a5\") " pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.922642 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.922465 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/26897061-21eb-4b9e-a798-f8d22f6005a5-snapshots\") pod \"insights-operator-5bbd86d6bd-hsvlk\" (UID: \"26897061-21eb-4b9e-a798-f8d22f6005a5\") " pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.922704 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.922644 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26897061-21eb-4b9e-a798-f8d22f6005a5-serving-cert\") pod \"insights-operator-5bbd86d6bd-hsvlk\" (UID: \"26897061-21eb-4b9e-a798-f8d22f6005a5\") " pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.924352 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.922745 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ecd58d5a-c77a-4130-9a10-b8869428bf6d-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5v2h6\" (UID: \"ecd58d5a-c77a-4130-9a10-b8869428bf6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6" Jun 14 15:57:12.924352 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.922785 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26897061-21eb-4b9e-a798-f8d22f6005a5-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-hsvlk\" (UID: \"26897061-21eb-4b9e-a798-f8d22f6005a5\") " pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.924352 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.922814 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnpgd\" (UniqueName: \"kubernetes.io/projected/ecd58d5a-c77a-4130-9a10-b8869428bf6d-kube-api-access-qnpgd\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5v2h6\" (UID: \"ecd58d5a-c77a-4130-9a10-b8869428bf6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6" Jun 14 15:57:12.924352 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.922867 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs8vk\" (UniqueName: \"kubernetes.io/projected/26897061-21eb-4b9e-a798-f8d22f6005a5-kube-api-access-rs8vk\") pod \"insights-operator-5bbd86d6bd-hsvlk\" (UID: \"26897061-21eb-4b9e-a798-f8d22f6005a5\") " pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.924352 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.922894 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecd58d5a-c77a-4130-9a10-b8869428bf6d-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5v2h6\" (UID: \"ecd58d5a-c77a-4130-9a10-b8869428bf6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6" Jun 14 15:57:12.924352 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.922931 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26897061-21eb-4b9e-a798-f8d22f6005a5-tmp\") pod \"insights-operator-5bbd86d6bd-hsvlk\" (UID: \"26897061-21eb-4b9e-a798-f8d22f6005a5\") " pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.924352 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.923194 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/26897061-21eb-4b9e-a798-f8d22f6005a5-snapshots\") pod \"insights-operator-5bbd86d6bd-hsvlk\" (UID: \"26897061-21eb-4b9e-a798-f8d22f6005a5\") " pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.924352 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.923271 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26897061-21eb-4b9e-a798-f8d22f6005a5-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-hsvlk\" (UID: \"26897061-21eb-4b9e-a798-f8d22f6005a5\") " pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.924352 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.923286 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26897061-21eb-4b9e-a798-f8d22f6005a5-tmp\") pod \"insights-operator-5bbd86d6bd-hsvlk\" (UID: \"26897061-21eb-4b9e-a798-f8d22f6005a5\") " pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.924352 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.924298 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26897061-21eb-4b9e-a798-f8d22f6005a5-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-hsvlk\" (UID: \"26897061-21eb-4b9e-a798-f8d22f6005a5\") " pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.924930 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.924812 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ecd58d5a-c77a-4130-9a10-b8869428bf6d-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5v2h6\" (UID: \"ecd58d5a-c77a-4130-9a10-b8869428bf6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6" Jun 14 15:57:12.925821 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.925778 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26897061-21eb-4b9e-a798-f8d22f6005a5-serving-cert\") pod \"insights-operator-5bbd86d6bd-hsvlk\" (UID: \"26897061-21eb-4b9e-a798-f8d22f6005a5\") " pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.926488 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.926175 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ecd58d5a-c77a-4130-9a10-b8869428bf6d-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5v2h6\" (UID: \"ecd58d5a-c77a-4130-9a10-b8869428bf6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6" Jun 14 15:57:12.935051 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.933657 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs8vk\" (UniqueName: \"kubernetes.io/projected/26897061-21eb-4b9e-a798-f8d22f6005a5-kube-api-access-rs8vk\") pod \"insights-operator-5bbd86d6bd-hsvlk\" (UID: \"26897061-21eb-4b9e-a798-f8d22f6005a5\") " pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:12.935051 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.934861 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnpgd\" (UniqueName: \"kubernetes.io/projected/ecd58d5a-c77a-4130-9a10-b8869428bf6d-kube-api-access-qnpgd\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5v2h6\" (UID: \"ecd58d5a-c77a-4130-9a10-b8869428bf6d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6" Jun 14 15:57:12.980665 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.980630 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6" Jun 14 15:57:12.990249 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:12.990040 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" Jun 14 15:57:13.035746 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:13.035538 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-b5tmd"] Jun 14 15:57:13.039388 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:57:13.039356 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80523acb_bab6_4e11_83b3_35af2852be80.slice/crio-f8e2d4dc67f60fc1ac9bb32d50cbe1c6012e825b69043e21ea2031443c8d72fa WatchSource:0}: Error finding container f8e2d4dc67f60fc1ac9bb32d50cbe1c6012e825b69043e21ea2031443c8d72fa: Status 404 returned error can't find the container with id f8e2d4dc67f60fc1ac9bb32d50cbe1c6012e825b69043e21ea2031443c8d72fa Jun 14 15:57:13.048297 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:13.046825 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz"] Jun 14 15:57:13.053060 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:57:13.052949 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7e3f8c_371f_448a_939c_3d88290bbeda.slice/crio-f2c8cc259a92b97dd9d5acc9b91d7cfe4794b3e199676757013eeeccb47563ef WatchSource:0}: Error finding container f2c8cc259a92b97dd9d5acc9b91d7cfe4794b3e199676757013eeeccb47563ef: Status 404 returned error can't find the container with id f2c8cc259a92b97dd9d5acc9b91d7cfe4794b3e199676757013eeeccb47563ef Jun 14 15:57:13.065773 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:13.065716 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kcdnc"] Jun 14 15:57:13.073825 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:57:13.073758 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833c74ce_b24b_426b_b7ec_566319790322.slice/crio-6e6e5cf0fe1886329503175691249350279a3aebe3c95dc2ba03f673ab0ccf86 WatchSource:0}: Error finding container 6e6e5cf0fe1886329503175691249350279a3aebe3c95dc2ba03f673ab0ccf86: Status 404 returned error can't find the container with id 6e6e5cf0fe1886329503175691249350279a3aebe3c95dc2ba03f673ab0ccf86 Jun 14 15:57:13.135730 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:13.135697 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6"] Jun 14 15:57:13.138795 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:57:13.138765 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecd58d5a_c77a_4130_9a10_b8869428bf6d.slice/crio-8919d585c9591c55955340829239d6c518b7ea01d7daf1cb472c36532ff34e4d WatchSource:0}: Error finding container 8919d585c9591c55955340829239d6c518b7ea01d7daf1cb472c36532ff34e4d: Status 404 returned error can't find the container with id 8919d585c9591c55955340829239d6c518b7ea01d7daf1cb472c36532ff34e4d Jun 14 15:57:13.155623 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:13.155591 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-hsvlk"] Jun 14 15:57:13.158751 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:57:13.158724 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26897061_21eb_4b9e_a798_f8d22f6005a5.slice/crio-50bbcaf001e0c896fabaffb9a652c9c9ef67f03b1f6b896169c1d56b6d7178ff WatchSource:0}: Error finding container 50bbcaf001e0c896fabaffb9a652c9c9ef67f03b1f6b896169c1d56b6d7178ff: Status 404 returned error can't find the container with id 50bbcaf001e0c896fabaffb9a652c9c9ef67f03b1f6b896169c1d56b6d7178ff Jun 14 15:57:13.226839 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:13.226797 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-wm26v\" (UID: \"0cb84e67-7dda-4d59-9e09-56e18da9d6a9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" Jun 14 15:57:13.227042 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:13.226962 2528 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 15:57:13.227110 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:13.227044 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls podName:0cb84e67-7dda-4d59-9e09-56e18da9d6a9 nodeName:}" failed. No retries permitted until 2026-06-14 15:57:14.227023092 +0000 UTC m=+235.156670782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-wm26v" (UID: "0cb84e67-7dda-4d59-9e09-56e18da9d6a9") : secret "cluster-monitoring-operator-tls" not found Jun 14 15:57:13.296268 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:13.296227 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kcdnc" event={"ID":"833c74ce-b24b-426b-b7ec-566319790322","Type":"ContainerStarted","Data":"6e6e5cf0fe1886329503175691249350279a3aebe3c95dc2ba03f673ab0ccf86"} Jun 14 15:57:13.297492 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:13.297463 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" event={"ID":"80523acb-bab6-4e11-83b3-35af2852be80","Type":"ContainerStarted","Data":"f8e2d4dc67f60fc1ac9bb32d50cbe1c6012e825b69043e21ea2031443c8d72fa"} Jun 14 15:57:13.298571 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:13.298536 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz" event={"ID":"ba7e3f8c-371f-448a-939c-3d88290bbeda","Type":"ContainerStarted","Data":"f2c8cc259a92b97dd9d5acc9b91d7cfe4794b3e199676757013eeeccb47563ef"} Jun 14 15:57:13.299526 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:13.299502 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" event={"ID":"26897061-21eb-4b9e-a798-f8d22f6005a5","Type":"ContainerStarted","Data":"50bbcaf001e0c896fabaffb9a652c9c9ef67f03b1f6b896169c1d56b6d7178ff"} Jun 14 15:57:13.300405 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:13.300386 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6" event={"ID":"ecd58d5a-c77a-4130-9a10-b8869428bf6d","Type":"ContainerStarted","Data":"8919d585c9591c55955340829239d6c518b7ea01d7daf1cb472c36532ff34e4d"} Jun 14 15:57:14.238643 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:14.237742 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-wm26v\" (UID: \"0cb84e67-7dda-4d59-9e09-56e18da9d6a9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" Jun 14 15:57:14.238643 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:14.237957 2528 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 15:57:14.238643 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:14.238093 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls podName:0cb84e67-7dda-4d59-9e09-56e18da9d6a9 nodeName:}" failed. No retries permitted until 2026-06-14 15:57:16.238029187 +0000 UTC m=+237.167676861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-wm26v" (UID: "0cb84e67-7dda-4d59-9e09-56e18da9d6a9") : secret "cluster-monitoring-operator-tls" not found Jun 14 15:57:15.309510 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:15.309469 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kcdnc" event={"ID":"833c74ce-b24b-426b-b7ec-566319790322","Type":"ContainerStarted","Data":"17ac37fbdf2ca499e845cdd1b7d275128bd10eff0e4702b64270f4d3626e5233"} Jun 14 15:57:15.325426 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:15.325360 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-kcdnc" podStartSLOduration=2.100427676 podStartE2EDuration="3.325334894s" totalImagesPullingTime="1.224907218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:57:15.324706703 +0000 UTC m=+236.254354398" watchObservedRunningTime="2026-06-14 15:57:15.325334894 +0000 UTC m=+236.254982571" Jun 14 15:57:16.255967 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:16.255932 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-wm26v\" (UID: \"0cb84e67-7dda-4d59-9e09-56e18da9d6a9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" Jun 14 15:57:16.256148 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:16.256126 2528 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 15:57:16.256231 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:16.256201 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls podName:0cb84e67-7dda-4d59-9e09-56e18da9d6a9 nodeName:}" failed. No retries permitted until 2026-06-14 15:57:20.256183775 +0000 UTC m=+241.185831469 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-wm26v" (UID: "0cb84e67-7dda-4d59-9e09-56e18da9d6a9") : secret "cluster-monitoring-operator-tls" not found Jun 14 15:57:17.318602 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:17.318567 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b5tmd_80523acb-bab6-4e11-83b3-35af2852be80/console-operator/0.log" Jun 14 15:57:17.319071 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:17.318619 2528 generic.go:356] "Generic (PLEG): container finished" podID="80523acb-bab6-4e11-83b3-35af2852be80" containerID="aa6b0f2c0d3cd36df8420c9cdf9f63f1c8e19627b30ac5c25b83a2e95d19c844" exitCode=255 Jun 14 15:57:17.319071 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:17.318712 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" event={"ID":"80523acb-bab6-4e11-83b3-35af2852be80","Type":"ContainerDied","Data":"aa6b0f2c0d3cd36df8420c9cdf9f63f1c8e19627b30ac5c25b83a2e95d19c844"} Jun 14 15:57:17.319071 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:17.319037 2528 scope.go:117] "RemoveContainer" containerID="aa6b0f2c0d3cd36df8420c9cdf9f63f1c8e19627b30ac5c25b83a2e95d19c844" Jun 14 15:57:17.320423 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:17.320365 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz" event={"ID":"ba7e3f8c-371f-448a-939c-3d88290bbeda","Type":"ContainerStarted","Data":"5d9d7a0a1bff70ef92ad3082dbc2c08ff71cc7ab1dd6cabf78ca70aed4184f94"} Jun 14 15:57:17.322494 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:17.322461 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" event={"ID":"26897061-21eb-4b9e-a798-f8d22f6005a5","Type":"ContainerStarted","Data":"8f6d9958767415e0f9ab9aa5434adaaca41527190e84b74b4ff1d1cc98334785"} Jun 14 15:57:17.324362 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:17.324334 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6" event={"ID":"ecd58d5a-c77a-4130-9a10-b8869428bf6d","Type":"ContainerStarted","Data":"f3c88daa53ac7e76cf684a65e2235a6604b66d2b3ff9d1a9badf194aa65ced86"} Jun 14 15:57:17.351089 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:17.351036 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz" podStartSLOduration=1.5955227779999999 podStartE2EDuration="5.351018839s" totalImagesPullingTime="3.755496061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:57:17.350253927 +0000 UTC m=+238.279901624" watchObservedRunningTime="2026-06-14 15:57:17.351018839 +0000 UTC m=+238.280666533" Jun 14 15:57:17.366619 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:17.366572 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" podStartSLOduration=1.7131726189999998 podStartE2EDuration="5.366552383s" totalImagesPullingTime="3.653379764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:57:17.366207173 +0000 UTC m=+238.295854871" watchObservedRunningTime="2026-06-14 15:57:17.366552383 +0000 UTC m=+238.296200079" Jun 14 15:57:17.383863 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:17.383801 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6" podStartSLOduration=1.715335458 podStartE2EDuration="5.383778338s" totalImagesPullingTime="3.66844288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:57:17.383158402 +0000 UTC m=+238.312806121" watchObservedRunningTime="2026-06-14 15:57:17.383778338 +0000 UTC m=+238.313426031" Jun 14 15:57:18.328742 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.328707 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b5tmd_80523acb-bab6-4e11-83b3-35af2852be80/console-operator/1.log" Jun 14 15:57:18.329276 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.329146 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b5tmd_80523acb-bab6-4e11-83b3-35af2852be80/console-operator/0.log" Jun 14 15:57:18.329276 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.329180 2528 generic.go:356] "Generic (PLEG): container finished" podID="80523acb-bab6-4e11-83b3-35af2852be80" containerID="082b3c4f2e72cf461b9523a4f285f728bc7f3356cb0add602017b473dd1ab704" exitCode=255 Jun 14 15:57:18.329458 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.329308 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" event={"ID":"80523acb-bab6-4e11-83b3-35af2852be80","Type":"ContainerDied","Data":"082b3c4f2e72cf461b9523a4f285f728bc7f3356cb0add602017b473dd1ab704"} Jun 14 15:57:18.329458 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.329358 2528 scope.go:117] "RemoveContainer" containerID="aa6b0f2c0d3cd36df8420c9cdf9f63f1c8e19627b30ac5c25b83a2e95d19c844" Jun 14 15:57:18.329612 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.329585 2528 scope.go:117] "RemoveContainer" containerID="082b3c4f2e72cf461b9523a4f285f728bc7f3356cb0add602017b473dd1ab704" Jun 14 15:57:18.329807 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:18.329780 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-b5tmd_openshift-console-operator(80523acb-bab6-4e11-83b3-35af2852be80)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" podUID="80523acb-bab6-4e11-83b3-35af2852be80" Jun 14 15:57:18.411191 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.411159 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fwthx"] Jun 14 15:57:18.415622 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.415597 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:18.418013 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.417988 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 15:57:18.418151 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.418031 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-b5gfg\"" Jun 14 15:57:18.418151 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.418051 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 15:57:18.428576 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.427612 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fwthx"] Jun 14 15:57:18.580046 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.579946 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df19f877-e7c4-42d3-a64d-72aa5bee885f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:18.580046 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.579987 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df19f877-e7c4-42d3-a64d-72aa5bee885f-data-volume\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:18.580046 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.580010 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:18.580297 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.580086 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df19f877-e7c4-42d3-a64d-72aa5bee885f-crio-socket\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:18.580297 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.580184 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjtz9\" (UniqueName: \"kubernetes.io/projected/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-api-access-tjtz9\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:18.681125 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.681079 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjtz9\" (UniqueName: \"kubernetes.io/projected/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-api-access-tjtz9\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:18.681125 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.681138 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df19f877-e7c4-42d3-a64d-72aa5bee885f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:18.681407 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.681156 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df19f877-e7c4-42d3-a64d-72aa5bee885f-data-volume\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:18.681407 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:18.681269 2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 15:57:18.681407 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.681280 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:18.681407 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.681321 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df19f877-e7c4-42d3-a64d-72aa5bee885f-crio-socket\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:18.681407 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:18.681342 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df19f877-e7c4-42d3-a64d-72aa5bee885f-insights-runtime-extractor-tls podName:df19f877-e7c4-42d3-a64d-72aa5bee885f nodeName:}" failed. No retries permitted until 2026-06-14 15:57:19.181320669 +0000 UTC m=+240.110968359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df19f877-e7c4-42d3-a64d-72aa5bee885f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fwthx" (UID: "df19f877-e7c4-42d3-a64d-72aa5bee885f") : secret "insights-runtime-extractor-tls" not found Jun 14 15:57:18.681407 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.681381 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df19f877-e7c4-42d3-a64d-72aa5bee885f-crio-socket\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:18.681407 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:18.681388 2528 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 15:57:18.681673 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:18.681474 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-rbac-proxy-cm podName:df19f877-e7c4-42d3-a64d-72aa5bee885f nodeName:}" failed. No retries permitted until 2026-06-14 15:57:19.18146181 +0000 UTC m=+240.111109502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fwthx" (UID: "df19f877-e7c4-42d3-a64d-72aa5bee885f") : configmap "kube-rbac-proxy" not found Jun 14 15:57:18.681673 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.681495 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df19f877-e7c4-42d3-a64d-72aa5bee885f-data-volume\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:18.689353 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:18.689322 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjtz9\" (UniqueName: \"kubernetes.io/projected/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-api-access-tjtz9\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:19.186452 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:19.186413 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df19f877-e7c4-42d3-a64d-72aa5bee885f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:19.186452 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:19.186459 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:19.186670 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:19.186573 2528 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 15:57:19.186670 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:19.186572 2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 15:57:19.186670 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:19.186626 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-rbac-proxy-cm podName:df19f877-e7c4-42d3-a64d-72aa5bee885f nodeName:}" failed. No retries permitted until 2026-06-14 15:57:20.186612397 +0000 UTC m=+241.116260070 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fwthx" (UID: "df19f877-e7c4-42d3-a64d-72aa5bee885f") : configmap "kube-rbac-proxy" not found Jun 14 15:57:19.186670 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:19.186640 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df19f877-e7c4-42d3-a64d-72aa5bee885f-insights-runtime-extractor-tls podName:df19f877-e7c4-42d3-a64d-72aa5bee885f nodeName:}" failed. No retries permitted until 2026-06-14 15:57:20.186633533 +0000 UTC m=+241.116281206 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df19f877-e7c4-42d3-a64d-72aa5bee885f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fwthx" (UID: "df19f877-e7c4-42d3-a64d-72aa5bee885f") : secret "insights-runtime-extractor-tls" not found Jun 14 15:57:19.334621 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:19.334588 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b5tmd_80523acb-bab6-4e11-83b3-35af2852be80/console-operator/1.log" Jun 14 15:57:19.334998 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:19.334935 2528 scope.go:117] "RemoveContainer" containerID="082b3c4f2e72cf461b9523a4f285f728bc7f3356cb0add602017b473dd1ab704" Jun 14 15:57:19.335108 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:19.335087 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-b5tmd_openshift-console-operator(80523acb-bab6-4e11-83b3-35af2852be80)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" podUID="80523acb-bab6-4e11-83b3-35af2852be80" Jun 14 15:57:20.196341 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.196301 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df19f877-e7c4-42d3-a64d-72aa5bee885f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:20.196535 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.196356 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:20.196535 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:20.196473 2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 15:57:20.196535 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:20.196507 2528 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 15:57:20.196637 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:20.196551 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df19f877-e7c4-42d3-a64d-72aa5bee885f-insights-runtime-extractor-tls podName:df19f877-e7c4-42d3-a64d-72aa5bee885f nodeName:}" failed. No retries permitted until 2026-06-14 15:57:22.196532641 +0000 UTC m=+243.126180330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df19f877-e7c4-42d3-a64d-72aa5bee885f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fwthx" (UID: "df19f877-e7c4-42d3-a64d-72aa5bee885f") : secret "insights-runtime-extractor-tls" not found Jun 14 15:57:20.196637 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:20.196569 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-rbac-proxy-cm podName:df19f877-e7c4-42d3-a64d-72aa5bee885f nodeName:}" failed. No retries permitted until 2026-06-14 15:57:22.19656242 +0000 UTC m=+243.126210093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fwthx" (UID: "df19f877-e7c4-42d3-a64d-72aa5bee885f") : configmap "kube-rbac-proxy" not found Jun 14 15:57:20.297781 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.297729 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-wm26v\" (UID: \"0cb84e67-7dda-4d59-9e09-56e18da9d6a9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" Jun 14 15:57:20.297965 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:20.297895 2528 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 15:57:20.297965 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:20.297959 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls podName:0cb84e67-7dda-4d59-9e09-56e18da9d6a9 nodeName:}" failed. No retries permitted until 2026-06-14 15:57:28.297943694 +0000 UTC m=+249.227591367 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-wm26v" (UID: "0cb84e67-7dda-4d59-9e09-56e18da9d6a9") : secret "cluster-monitoring-operator-tls" not found Jun 14 15:57:20.550571 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.550488 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-8m5dm"] Jun 14 15:57:20.553814 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.553794 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-8m5dm" Jun 14 15:57:20.556010 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.555981 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 14 15:57:20.556650 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.556625 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 14 15:57:20.556755 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.556650 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 14 15:57:20.556755 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.556713 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dcqbk\"" Jun 14 15:57:20.556755 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.556714 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 14 15:57:20.563434 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.563404 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-8m5dm"] Jun 14 15:57:20.702352 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.702307 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/99a1a80c-cb09-4e15-a458-ca85fda94d3c-signing-key\") pod \"service-ca-7b994bc59-8m5dm\" (UID: \"99a1a80c-cb09-4e15-a458-ca85fda94d3c\") " pod="openshift-service-ca/service-ca-7b994bc59-8m5dm" Jun 14 15:57:20.702352 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.702354 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf5h9\" (UniqueName: \"kubernetes.io/projected/99a1a80c-cb09-4e15-a458-ca85fda94d3c-kube-api-access-qf5h9\") pod \"service-ca-7b994bc59-8m5dm\" (UID: \"99a1a80c-cb09-4e15-a458-ca85fda94d3c\") " pod="openshift-service-ca/service-ca-7b994bc59-8m5dm" Jun 14 15:57:20.702574 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.702407 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/99a1a80c-cb09-4e15-a458-ca85fda94d3c-signing-cabundle\") pod \"service-ca-7b994bc59-8m5dm\" (UID: \"99a1a80c-cb09-4e15-a458-ca85fda94d3c\") " pod="openshift-service-ca/service-ca-7b994bc59-8m5dm" Jun 14 15:57:20.803576 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.803479 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/99a1a80c-cb09-4e15-a458-ca85fda94d3c-signing-key\") pod \"service-ca-7b994bc59-8m5dm\" (UID: \"99a1a80c-cb09-4e15-a458-ca85fda94d3c\") " pod="openshift-service-ca/service-ca-7b994bc59-8m5dm" Jun 14 15:57:20.803576 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.803520 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf5h9\" (UniqueName: \"kubernetes.io/projected/99a1a80c-cb09-4e15-a458-ca85fda94d3c-kube-api-access-qf5h9\") pod \"service-ca-7b994bc59-8m5dm\" (UID: \"99a1a80c-cb09-4e15-a458-ca85fda94d3c\") " pod="openshift-service-ca/service-ca-7b994bc59-8m5dm" Jun 14 15:57:20.803576 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.803556 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/99a1a80c-cb09-4e15-a458-ca85fda94d3c-signing-cabundle\") pod \"service-ca-7b994bc59-8m5dm\" (UID: \"99a1a80c-cb09-4e15-a458-ca85fda94d3c\") " pod="openshift-service-ca/service-ca-7b994bc59-8m5dm" Jun 14 15:57:20.804121 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.804100 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/99a1a80c-cb09-4e15-a458-ca85fda94d3c-signing-cabundle\") pod \"service-ca-7b994bc59-8m5dm\" (UID: \"99a1a80c-cb09-4e15-a458-ca85fda94d3c\") " pod="openshift-service-ca/service-ca-7b994bc59-8m5dm" Jun 14 15:57:20.806339 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.806297 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/99a1a80c-cb09-4e15-a458-ca85fda94d3c-signing-key\") pod \"service-ca-7b994bc59-8m5dm\" (UID: \"99a1a80c-cb09-4e15-a458-ca85fda94d3c\") " pod="openshift-service-ca/service-ca-7b994bc59-8m5dm" Jun 14 15:57:20.813879 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.813844 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf5h9\" (UniqueName: \"kubernetes.io/projected/99a1a80c-cb09-4e15-a458-ca85fda94d3c-kube-api-access-qf5h9\") pod \"service-ca-7b994bc59-8m5dm\" (UID: \"99a1a80c-cb09-4e15-a458-ca85fda94d3c\") " pod="openshift-service-ca/service-ca-7b994bc59-8m5dm" Jun 14 15:57:20.868701 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:20.868660 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-8m5dm" Jun 14 15:57:21.002599 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:21.002562 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-8m5dm"] Jun 14 15:57:21.006019 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:57:21.005977 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a1a80c_cb09_4e15_a458_ca85fda94d3c.slice/crio-84e9b144184b5897dfb20ef9bc4591bfef09b80d63b13bc8530aee973110f08d WatchSource:0}: Error finding container 84e9b144184b5897dfb20ef9bc4591bfef09b80d63b13bc8530aee973110f08d: Status 404 returned error can't find the container with id 84e9b144184b5897dfb20ef9bc4591bfef09b80d63b13bc8530aee973110f08d Jun 14 15:57:21.196380 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:21.196352 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tv4zb_ad18bf63-5cb1-49ed-8747-cf53066d4757/dns-node-resolver/0.log" Jun 14 15:57:21.346302 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:21.346185 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-8m5dm" event={"ID":"99a1a80c-cb09-4e15-a458-ca85fda94d3c","Type":"ContainerStarted","Data":"c96085d3d9ae2c3667c2e59076ef60be9416b0871678a67b442025027b129225"} Jun 14 15:57:21.346302 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:21.346266 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-8m5dm" event={"ID":"99a1a80c-cb09-4e15-a458-ca85fda94d3c","Type":"ContainerStarted","Data":"84e9b144184b5897dfb20ef9bc4591bfef09b80d63b13bc8530aee973110f08d"} Jun 14 15:57:21.365543 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:21.365476 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-8m5dm" podStartSLOduration=1.365454124 podStartE2EDuration="1.365454124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:57:21.363702837 +0000 UTC m=+242.293350531" watchObservedRunningTime="2026-06-14 15:57:21.365454124 +0000 UTC m=+242.295101820" Jun 14 15:57:22.213978 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:22.213936 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df19f877-e7c4-42d3-a64d-72aa5bee885f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:22.214506 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:22.214003 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:22.214506 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:22.214168 2528 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 15:57:22.214506 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:22.214264 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-rbac-proxy-cm podName:df19f877-e7c4-42d3-a64d-72aa5bee885f nodeName:}" failed. No retries permitted until 2026-06-14 15:57:26.214243993 +0000 UTC m=+247.143891683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fwthx" (UID: "df19f877-e7c4-42d3-a64d-72aa5bee885f") : configmap "kube-rbac-proxy" not found Jun 14 15:57:22.214506 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:22.214362 2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 15:57:22.214506 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:22.214398 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df19f877-e7c4-42d3-a64d-72aa5bee885f-insights-runtime-extractor-tls podName:df19f877-e7c4-42d3-a64d-72aa5bee885f nodeName:}" failed. No retries permitted until 2026-06-14 15:57:26.214387985 +0000 UTC m=+247.144035658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df19f877-e7c4-42d3-a64d-72aa5bee885f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fwthx" (UID: "df19f877-e7c4-42d3-a64d-72aa5bee885f") : secret "insights-runtime-extractor-tls" not found Jun 14 15:57:22.395892 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:22.395865 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x29bp_192f9064-28fa-4ccc-aae0-e6157e6ac308/node-ca/0.log" Jun 14 15:57:22.878827 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:22.878719 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" Jun 14 15:57:22.878827 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:22.878794 2528 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" Jun 14 15:57:22.879124 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:22.879111 2528 scope.go:117] "RemoveContainer" containerID="082b3c4f2e72cf461b9523a4f285f728bc7f3356cb0add602017b473dd1ab704" Jun 14 15:57:22.879308 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:22.879289 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-b5tmd_openshift-console-operator(80523acb-bab6-4e11-83b3-35af2852be80)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" podUID="80523acb-bab6-4e11-83b3-35af2852be80" Jun 14 15:57:22.996344 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:22.996316 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bpcbr_28eb3a88-ed18-482b-b2a5-3f43b1991ff5/serve-healthcheck-canary/0.log" Jun 14 15:57:23.797428 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:23.797387 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-5v2h6_ecd58d5a-c77a-4130-9a10-b8869428bf6d/kube-storage-version-migrator-operator/0.log" Jun 14 15:57:26.252659 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:26.252609 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:26.253149 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:26.252739 2528 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 15:57:26.253149 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:26.252764 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df19f877-e7c4-42d3-a64d-72aa5bee885f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:26.253149 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:26.252810 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-rbac-proxy-cm podName:df19f877-e7c4-42d3-a64d-72aa5bee885f nodeName:}" failed. No retries permitted until 2026-06-14 15:57:34.252794578 +0000 UTC m=+255.182442253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fwthx" (UID: "df19f877-e7c4-42d3-a64d-72aa5bee885f") : configmap "kube-rbac-proxy" not found Jun 14 15:57:26.253149 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:26.252900 2528 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 15:57:26.253149 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:26.252965 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df19f877-e7c4-42d3-a64d-72aa5bee885f-insights-runtime-extractor-tls podName:df19f877-e7c4-42d3-a64d-72aa5bee885f nodeName:}" failed. No retries permitted until 2026-06-14 15:57:34.252947464 +0000 UTC m=+255.182595137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/df19f877-e7c4-42d3-a64d-72aa5bee885f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fwthx" (UID: "df19f877-e7c4-42d3-a64d-72aa5bee885f") : secret "insights-runtime-extractor-tls" not found Jun 14 15:57:28.368844 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:28.368810 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-wm26v\" (UID: \"0cb84e67-7dda-4d59-9e09-56e18da9d6a9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" Jun 14 15:57:28.369294 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:28.368930 2528 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 15:57:28.369294 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:28.368983 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls podName:0cb84e67-7dda-4d59-9e09-56e18da9d6a9 nodeName:}" failed. No retries permitted until 2026-06-14 15:57:44.368970371 +0000 UTC m=+265.298618044 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-wm26v" (UID: "0cb84e67-7dda-4d59-9e09-56e18da9d6a9") : secret "cluster-monitoring-operator-tls" not found Jun 14 15:57:31.498407 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:31.498365 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs\") pod \"network-metrics-daemon-t5kjf\" (UID: \"36c343bd-9776-45d6-9fd4-6994edafd550\") " pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:57:31.500914 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:31.500879 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36c343bd-9776-45d6-9fd4-6994edafd550-metrics-certs\") pod \"network-metrics-daemon-t5kjf\" (UID: \"36c343bd-9776-45d6-9fd4-6994edafd550\") " pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:57:31.569821 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:31.569789 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zjrn2\"" Jun 14 15:57:31.577917 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:31.577897 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t5kjf" Jun 14 15:57:31.708108 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:31.708075 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t5kjf"] Jun 14 15:57:31.711074 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:57:31.711045 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c343bd_9776_45d6_9fd4_6994edafd550.slice/crio-5583fb9e2a50dcc80b34e32b68be55d4d3f6677e6d5c009ee94f562ca91bdd6c WatchSource:0}: Error finding container 5583fb9e2a50dcc80b34e32b68be55d4d3f6677e6d5c009ee94f562ca91bdd6c: Status 404 returned error can't find the container with id 5583fb9e2a50dcc80b34e32b68be55d4d3f6677e6d5c009ee94f562ca91bdd6c Jun 14 15:57:32.382189 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:32.382144 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t5kjf" event={"ID":"36c343bd-9776-45d6-9fd4-6994edafd550","Type":"ContainerStarted","Data":"5583fb9e2a50dcc80b34e32b68be55d4d3f6677e6d5c009ee94f562ca91bdd6c"} Jun 14 15:57:33.387372 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:33.387332 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t5kjf" event={"ID":"36c343bd-9776-45d6-9fd4-6994edafd550","Type":"ContainerStarted","Data":"8c377767d64e40ce6b6b78458a080d19eeed962932d5cd9481dda049b50c2784"} Jun 14 15:57:33.387769 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:33.387397 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t5kjf" event={"ID":"36c343bd-9776-45d6-9fd4-6994edafd550","Type":"ContainerStarted","Data":"d2a1b46263470c60de2a7c94da9da2dfe5832001cbc28d87134a8ddb6bc902e5"} Jun 14 15:57:33.402319 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:33.402263 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t5kjf" podStartSLOduration=253.4952993 podStartE2EDuration="4m14.402246695s" totalImagesPullingTime="906.947395ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:57:33.40093234 +0000 UTC m=+254.330580035" watchObservedRunningTime="2026-06-14 15:57:33.402246695 +0000 UTC m=+254.331894389" Jun 14 15:57:34.322627 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:34.322590 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df19f877-e7c4-42d3-a64d-72aa5bee885f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:34.322627 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:34.322637 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:34.323323 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:34.323299 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df19f877-e7c4-42d3-a64d-72aa5bee885f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:34.325375 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:34.325351 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df19f877-e7c4-42d3-a64d-72aa5bee885f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fwthx\" (UID: \"df19f877-e7c4-42d3-a64d-72aa5bee885f\") " pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:34.627078 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:34.626991 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-b5gfg\"" Jun 14 15:57:34.635516 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:34.635489 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fwthx" Jun 14 15:57:34.772103 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:34.771920 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fwthx"] Jun 14 15:57:34.774665 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:57:34.774638 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf19f877_e7c4_42d3_a64d_72aa5bee885f.slice/crio-f81b71085ff5d88e118157615822f9c7316f973097e89215ec88e9285c37466e WatchSource:0}: Error finding container f81b71085ff5d88e118157615822f9c7316f973097e89215ec88e9285c37466e: Status 404 returned error can't find the container with id f81b71085ff5d88e118157615822f9c7316f973097e89215ec88e9285c37466e Jun 14 15:57:35.396478 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:35.396389 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fwthx" event={"ID":"df19f877-e7c4-42d3-a64d-72aa5bee885f","Type":"ContainerStarted","Data":"f81b71085ff5d88e118157615822f9c7316f973097e89215ec88e9285c37466e"} Jun 14 15:57:35.566504 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:35.566462 2528 scope.go:117] "RemoveContainer" containerID="082b3c4f2e72cf461b9523a4f285f728bc7f3356cb0add602017b473dd1ab704" Jun 14 15:57:36.402645 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:36.402617 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b5tmd_80523acb-bab6-4e11-83b3-35af2852be80/console-operator/1.log" Jun 14 15:57:36.403082 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:36.402711 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" event={"ID":"80523acb-bab6-4e11-83b3-35af2852be80","Type":"ContainerStarted","Data":"ab313197aa83b874b0fb65410140d7373b8ddd3e46d7e9c8149419a6d2e90393"} Jun 14 15:57:36.403082 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:36.402966 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" Jun 14 15:57:36.408347 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:36.408316 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" Jun 14 15:57:36.425869 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:36.425816 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-b5tmd" podStartSLOduration=20.661372367 podStartE2EDuration="24.425796288s" totalImagesPullingTime="3.764423921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:57:36.424745116 +0000 UTC m=+257.354392812" watchObservedRunningTime="2026-06-14 15:57:36.425796288 +0000 UTC m=+257.355443987" Jun 14 15:57:38.410949 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:38.410907 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fwthx" event={"ID":"df19f877-e7c4-42d3-a64d-72aa5bee885f","Type":"ContainerStarted","Data":"e46eda7f231c2e76cc0c4927b9d7c1d5cf611863980b13f34deedabe2e9d4559"} Jun 14 15:57:39.417071 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:39.417030 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fwthx" event={"ID":"df19f877-e7c4-42d3-a64d-72aa5bee885f","Type":"ContainerStarted","Data":"d1031b159f38462121bed7c68ac4f00b31f363a7027a81f5f6ec44c69722a0fd"} Jun 14 15:57:41.425462 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:41.425422 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fwthx" event={"ID":"df19f877-e7c4-42d3-a64d-72aa5bee885f","Type":"ContainerStarted","Data":"0709071d325339255310b8ea3c9b353b660fb0998fe8dcda678a303c09772885"} Jun 14 15:57:41.443000 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:41.442944 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fwthx" podStartSLOduration=17.853977667 podStartE2EDuration="23.442928056s" totalImagesPullingTime="5.588950389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 15:57:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:57:41.442094989 +0000 UTC m=+262.371742685" watchObservedRunningTime="2026-06-14 15:57:41.442928056 +0000 UTC m=+262.372575758" Jun 14 15:57:43.774287 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:43.774245 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-mbthr"] Jun 14 15:57:43.777463 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:43.777437 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-mbthr" Jun 14 15:57:43.779530 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:43.779504 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nv8cc\"" Jun 14 15:57:43.779807 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:43.779774 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 15:57:43.779807 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:43.779789 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 15:57:43.789781 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:43.789755 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-mbthr"] Jun 14 15:57:43.808638 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:43.808601 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl28l\" (UniqueName: \"kubernetes.io/projected/a3edf5cf-6899-4036-9266-284f0fa2eb11-kube-api-access-kl28l\") pod \"downloads-694c955b9-mbthr\" (UID: \"a3edf5cf-6899-4036-9266-284f0fa2eb11\") " pod="openshift-console/downloads-694c955b9-mbthr" Jun 14 15:57:43.909376 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:43.909337 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl28l\" (UniqueName: \"kubernetes.io/projected/a3edf5cf-6899-4036-9266-284f0fa2eb11-kube-api-access-kl28l\") pod \"downloads-694c955b9-mbthr\" (UID: \"a3edf5cf-6899-4036-9266-284f0fa2eb11\") " pod="openshift-console/downloads-694c955b9-mbthr" Jun 14 15:57:43.919590 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:43.919556 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl28l\" (UniqueName: \"kubernetes.io/projected/a3edf5cf-6899-4036-9266-284f0fa2eb11-kube-api-access-kl28l\") pod \"downloads-694c955b9-mbthr\" (UID: \"a3edf5cf-6899-4036-9266-284f0fa2eb11\") " pod="openshift-console/downloads-694c955b9-mbthr" Jun 14 15:57:44.087806 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:44.087710 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-mbthr" Jun 14 15:57:44.247695 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:44.247506 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-mbthr"] Jun 14 15:57:44.250451 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:57:44.250417 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3edf5cf_6899_4036_9266_284f0fa2eb11.slice/crio-f6cccb6bd66d790f168bb58675236b1cdd27b330857acbd6142db5a0986de593 WatchSource:0}: Error finding container f6cccb6bd66d790f168bb58675236b1cdd27b330857acbd6142db5a0986de593: Status 404 returned error can't find the container with id f6cccb6bd66d790f168bb58675236b1cdd27b330857acbd6142db5a0986de593 Jun 14 15:57:44.413758 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:44.413713 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-wm26v\" (UID: \"0cb84e67-7dda-4d59-9e09-56e18da9d6a9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" Jun 14 15:57:44.416333 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:44.416308 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cb84e67-7dda-4d59-9e09-56e18da9d6a9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-wm26v\" (UID: \"0cb84e67-7dda-4d59-9e09-56e18da9d6a9\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" Jun 14 15:57:44.436628 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:44.436594 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-mbthr" event={"ID":"a3edf5cf-6899-4036-9266-284f0fa2eb11","Type":"ContainerStarted","Data":"f6cccb6bd66d790f168bb58675236b1cdd27b330857acbd6142db5a0986de593"} Jun 14 15:57:44.668039 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:44.667962 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-25447\"" Jun 14 15:57:44.676483 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:44.676455 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" Jun 14 15:57:44.821180 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:44.821141 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v"] Jun 14 15:57:44.824685 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:57:44.824647 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb84e67_7dda_4d59_9e09_56e18da9d6a9.slice/crio-244dcb1574703c8f2ffc36821b1c17e089479a7683515bce9ccd51d4b26e4dbd WatchSource:0}: Error finding container 244dcb1574703c8f2ffc36821b1c17e089479a7683515bce9ccd51d4b26e4dbd: Status 404 returned error can't find the container with id 244dcb1574703c8f2ffc36821b1c17e089479a7683515bce9ccd51d4b26e4dbd Jun 14 15:57:45.442407 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:45.442362 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" event={"ID":"0cb84e67-7dda-4d59-9e09-56e18da9d6a9","Type":"ContainerStarted","Data":"244dcb1574703c8f2ffc36821b1c17e089479a7683515bce9ccd51d4b26e4dbd"} Jun 14 15:57:47.144512 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:47.144462 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-84c22"] Jun 14 15:57:47.147876 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:47.147842 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-84c22" Jun 14 15:57:47.150021 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:47.149984 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 14 15:57:47.150021 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:47.150004 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-n59qc\"" Jun 14 15:57:47.157609 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:47.157583 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-84c22"] Jun 14 15:57:47.241605 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:47.241560 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8c33d570-44c8-430e-8a85-45ec4e60bf12-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-84c22\" (UID: \"8c33d570-44c8-430e-8a85-45ec4e60bf12\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-84c22" Jun 14 15:57:47.342297 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:47.342253 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8c33d570-44c8-430e-8a85-45ec4e60bf12-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-84c22\" (UID: \"8c33d570-44c8-430e-8a85-45ec4e60bf12\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-84c22" Jun 14 15:57:47.345135 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:47.345107 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8c33d570-44c8-430e-8a85-45ec4e60bf12-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-84c22\" (UID: \"8c33d570-44c8-430e-8a85-45ec4e60bf12\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-84c22" Jun 14 15:57:47.452821 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:47.452736 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" event={"ID":"0cb84e67-7dda-4d59-9e09-56e18da9d6a9","Type":"ContainerStarted","Data":"02297a92864accc378aa1b6f993a0b1bb60ec07c58b00f9512366ccc970be81a"} Jun 14 15:57:47.460761 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:47.460719 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-84c22" Jun 14 15:57:47.468795 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:47.468726 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-wm26v" podStartSLOduration=33.729569427 podStartE2EDuration="35.468701286s" totalImagesPullingTime="1.739131859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:57:47.468046342 +0000 UTC m=+268.397694037" watchObservedRunningTime="2026-06-14 15:57:47.468701286 +0000 UTC m=+268.398348982" Jun 14 15:57:47.619086 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:47.619008 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-84c22"] Jun 14 15:57:47.624902 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:57:47.624856 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c33d570_44c8_430e_8a85_45ec4e60bf12.slice/crio-73cb507c1da8b60769a5b54e84f348baa8a9ac5679fc3cbaa83db34b07445d65 WatchSource:0}: Error finding container 73cb507c1da8b60769a5b54e84f348baa8a9ac5679fc3cbaa83db34b07445d65: Status 404 returned error can't find the container with id 73cb507c1da8b60769a5b54e84f348baa8a9ac5679fc3cbaa83db34b07445d65 Jun 14 15:57:48.458029 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:48.457981 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-84c22" event={"ID":"8c33d570-44c8-430e-8a85-45ec4e60bf12","Type":"ContainerStarted","Data":"73cb507c1da8b60769a5b54e84f348baa8a9ac5679fc3cbaa83db34b07445d65"} Jun 14 15:57:49.463949 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:49.463912 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-84c22" event={"ID":"8c33d570-44c8-430e-8a85-45ec4e60bf12","Type":"ContainerStarted","Data":"c613889a1d07cead38de5b5cc3ffa80c365ec5cc953293394ee3d78ff0fbfb86"} Jun 14 15:57:49.464467 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:49.464137 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-84c22" Jun 14 15:57:49.469933 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:49.469899 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-84c22" Jun 14 15:57:49.480209 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:49.480155 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-84c22" podStartSLOduration=1.407639755 podStartE2EDuration="2.480134331s" totalImagesPullingTime="1.072494576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:57:49.478748361 +0000 UTC m=+270.408396057" watchObservedRunningTime="2026-06-14 15:57:49.480134331 +0000 UTC m=+270.409782028" Jun 14 15:57:50.195752 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.195719 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg"] Jun 14 15:57:50.218965 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.218928 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg"] Jun 14 15:57:50.219156 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.219075 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" Jun 14 15:57:50.222592 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.221769 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 14 15:57:50.222592 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.221889 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 15:57:50.222592 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.221995 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 14 15:57:50.222592 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.222036 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vvqnz\"" Jun 14 15:57:50.269813 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.269774 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dd57825-fa2f-488b-a894-787b30229c8a-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-zlszg\" (UID: \"1dd57825-fa2f-488b-a894-787b30229c8a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" Jun 14 15:57:50.270013 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.269843 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbpcm\" (UniqueName: \"kubernetes.io/projected/1dd57825-fa2f-488b-a894-787b30229c8a-kube-api-access-wbpcm\") pod \"prometheus-operator-864fcfc6f9-zlszg\" (UID: \"1dd57825-fa2f-488b-a894-787b30229c8a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" Jun 14 15:57:50.270013 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.269929 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dd57825-fa2f-488b-a894-787b30229c8a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-zlszg\" (UID: \"1dd57825-fa2f-488b-a894-787b30229c8a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" Jun 14 15:57:50.270130 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.270033 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dd57825-fa2f-488b-a894-787b30229c8a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-zlszg\" (UID: \"1dd57825-fa2f-488b-a894-787b30229c8a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" Jun 14 15:57:50.371061 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.370994 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbpcm\" (UniqueName: \"kubernetes.io/projected/1dd57825-fa2f-488b-a894-787b30229c8a-kube-api-access-wbpcm\") pod \"prometheus-operator-864fcfc6f9-zlszg\" (UID: \"1dd57825-fa2f-488b-a894-787b30229c8a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" Jun 14 15:57:50.371061 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.371053 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dd57825-fa2f-488b-a894-787b30229c8a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-zlszg\" (UID: \"1dd57825-fa2f-488b-a894-787b30229c8a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" Jun 14 15:57:50.371385 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.371094 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dd57825-fa2f-488b-a894-787b30229c8a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-zlszg\" (UID: \"1dd57825-fa2f-488b-a894-787b30229c8a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" Jun 14 15:57:50.371385 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.371172 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dd57825-fa2f-488b-a894-787b30229c8a-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-zlszg\" (UID: \"1dd57825-fa2f-488b-a894-787b30229c8a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" Jun 14 15:57:50.371385 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:50.371258 2528 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 14 15:57:50.371385 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:50.371323 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dd57825-fa2f-488b-a894-787b30229c8a-prometheus-operator-tls podName:1dd57825-fa2f-488b-a894-787b30229c8a nodeName:}" failed. No retries permitted until 2026-06-14 15:57:50.871304962 +0000 UTC m=+271.800952638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1dd57825-fa2f-488b-a894-787b30229c8a-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-zlszg" (UID: "1dd57825-fa2f-488b-a894-787b30229c8a") : secret "prometheus-operator-tls" not found Jun 14 15:57:50.372066 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.372040 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dd57825-fa2f-488b-a894-787b30229c8a-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-zlszg\" (UID: \"1dd57825-fa2f-488b-a894-787b30229c8a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" Jun 14 15:57:50.374253 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.374207 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dd57825-fa2f-488b-a894-787b30229c8a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-zlszg\" (UID: \"1dd57825-fa2f-488b-a894-787b30229c8a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" Jun 14 15:57:50.380099 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.380038 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbpcm\" (UniqueName: \"kubernetes.io/projected/1dd57825-fa2f-488b-a894-787b30229c8a-kube-api-access-wbpcm\") pod \"prometheus-operator-864fcfc6f9-zlszg\" (UID: \"1dd57825-fa2f-488b-a894-787b30229c8a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" Jun 14 15:57:50.874881 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.874841 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dd57825-fa2f-488b-a894-787b30229c8a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-zlszg\" (UID: \"1dd57825-fa2f-488b-a894-787b30229c8a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" Jun 14 15:57:50.877653 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:50.877627 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dd57825-fa2f-488b-a894-787b30229c8a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-zlszg\" (UID: \"1dd57825-fa2f-488b-a894-787b30229c8a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" Jun 14 15:57:51.131307 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:51.131209 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" Jun 14 15:57:51.302998 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:51.302962 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg"] Jun 14 15:57:51.306968 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:57:51.306926 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd57825_fa2f_488b_a894_787b30229c8a.slice/crio-4a3965b85fb2cc032c38a90ed9152718b98f882f49d55462f10e4dcf8d1202dc WatchSource:0}: Error finding container 4a3965b85fb2cc032c38a90ed9152718b98f882f49d55462f10e4dcf8d1202dc: Status 404 returned error can't find the container with id 4a3965b85fb2cc032c38a90ed9152718b98f882f49d55462f10e4dcf8d1202dc Jun 14 15:57:51.474067 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:51.474027 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" event={"ID":"1dd57825-fa2f-488b-a894-787b30229c8a","Type":"ContainerStarted","Data":"4a3965b85fb2cc032c38a90ed9152718b98f882f49d55462f10e4dcf8d1202dc"} Jun 14 15:57:53.485152 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:53.485111 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" event={"ID":"1dd57825-fa2f-488b-a894-787b30229c8a","Type":"ContainerStarted","Data":"7bb66f9a2a0d96421c6d676eea7350feb08a109066868b0dedd2987d7c034966"} Jun 14 15:57:53.485603 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:53.485243 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" event={"ID":"1dd57825-fa2f-488b-a894-787b30229c8a","Type":"ContainerStarted","Data":"9f1d8311f79e42c504b1ca4bc82a3d4cabc2bc9e6397d843989c4d5bfcb8f122"} Jun 14 15:57:53.501320 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:53.501268 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-zlszg" podStartSLOduration=2.208807145 podStartE2EDuration="3.501252204s" totalImagesPullingTime="1.292445059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:57:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:57:53.500566984 +0000 UTC m=+274.430214679" watchObservedRunningTime="2026-06-14 15:57:53.501252204 +0000 UTC m=+274.430899899" Jun 14 15:57:55.526058 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.526015 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r"] Jun 14 15:57:55.530804 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.530774 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" Jun 14 15:57:55.533701 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.533065 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 14 15:57:55.533701 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.533375 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 14 15:57:55.533701 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.533551 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tgzj2\"" Jun 14 15:57:55.545064 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.545030 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r"] Jun 14 15:57:55.561711 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.561654 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n69lv"] Jun 14 15:57:55.565732 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.565691 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.568048 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.568021 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 15:57:55.568658 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.568332 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 15:57:55.568658 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.568050 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 15:57:55.568835 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.568680 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hqvpd\"" Jun 14 15:57:55.620178 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.620001 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blnkj\" (UniqueName: \"kubernetes.io/projected/5409def3-4053-4c2a-8fae-26b60970c0fc-kube-api-access-blnkj\") pod \"openshift-state-metrics-6b8d965dd5-2cf7r\" (UID: \"5409def3-4053-4c2a-8fae-26b60970c0fc\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" Jun 14 15:57:55.620391 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.620190 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5409def3-4053-4c2a-8fae-26b60970c0fc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-2cf7r\" (UID: \"5409def3-4053-4c2a-8fae-26b60970c0fc\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" Jun 14 15:57:55.620391 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.620288 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5409def3-4053-4c2a-8fae-26b60970c0fc-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-2cf7r\" (UID: \"5409def3-4053-4c2a-8fae-26b60970c0fc\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" Jun 14 15:57:55.620391 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.620325 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5409def3-4053-4c2a-8fae-26b60970c0fc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-2cf7r\" (UID: \"5409def3-4053-4c2a-8fae-26b60970c0fc\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" Jun 14 15:57:55.720878 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.720777 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7db11eea-9e0f-49fd-8ffd-0620c1136a10-node-exporter-tls\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.720878 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.720841 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7db11eea-9e0f-49fd-8ffd-0620c1136a10-node-exporter-wtmp\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.720878 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.720876 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7db11eea-9e0f-49fd-8ffd-0620c1136a10-node-exporter-accelerators-collector-config\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.721185 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.720918 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7db11eea-9e0f-49fd-8ffd-0620c1136a10-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.721185 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.720952 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5409def3-4053-4c2a-8fae-26b60970c0fc-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-2cf7r\" (UID: \"5409def3-4053-4c2a-8fae-26b60970c0fc\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" Jun 14 15:57:55.721185 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.721000 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5409def3-4053-4c2a-8fae-26b60970c0fc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-2cf7r\" (UID: \"5409def3-4053-4c2a-8fae-26b60970c0fc\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" Jun 14 15:57:55.721185 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.721042 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwbjf\" (UniqueName: \"kubernetes.io/projected/7db11eea-9e0f-49fd-8ffd-0620c1136a10-kube-api-access-rwbjf\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.721185 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.721072 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blnkj\" (UniqueName: \"kubernetes.io/projected/5409def3-4053-4c2a-8fae-26b60970c0fc-kube-api-access-blnkj\") pod \"openshift-state-metrics-6b8d965dd5-2cf7r\" (UID: \"5409def3-4053-4c2a-8fae-26b60970c0fc\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" Jun 14 15:57:55.721185 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.721098 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7db11eea-9e0f-49fd-8ffd-0620c1136a10-node-exporter-textfile\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.721185 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.721169 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7db11eea-9e0f-49fd-8ffd-0620c1136a10-sys\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.722389 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.721235 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5409def3-4053-4c2a-8fae-26b60970c0fc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-2cf7r\" (UID: \"5409def3-4053-4c2a-8fae-26b60970c0fc\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" Jun 14 15:57:55.722389 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.721261 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7db11eea-9e0f-49fd-8ffd-0620c1136a10-root\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.722389 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.721290 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7db11eea-9e0f-49fd-8ffd-0620c1136a10-metrics-client-ca\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.722389 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:55.721669 2528 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 14 15:57:55.722389 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:55.721730 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5409def3-4053-4c2a-8fae-26b60970c0fc-openshift-state-metrics-tls podName:5409def3-4053-4c2a-8fae-26b60970c0fc nodeName:}" failed. No retries permitted until 2026-06-14 15:57:56.221711988 +0000 UTC m=+277.151359679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5409def3-4053-4c2a-8fae-26b60970c0fc-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-2cf7r" (UID: "5409def3-4053-4c2a-8fae-26b60970c0fc") : secret "openshift-state-metrics-tls" not found Jun 14 15:57:55.722389 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.721778 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5409def3-4053-4c2a-8fae-26b60970c0fc-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-2cf7r\" (UID: \"5409def3-4053-4c2a-8fae-26b60970c0fc\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" Jun 14 15:57:55.724467 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.724414 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5409def3-4053-4c2a-8fae-26b60970c0fc-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-2cf7r\" (UID: \"5409def3-4053-4c2a-8fae-26b60970c0fc\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" Jun 14 15:57:55.736194 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.736166 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blnkj\" (UniqueName: \"kubernetes.io/projected/5409def3-4053-4c2a-8fae-26b60970c0fc-kube-api-access-blnkj\") pod \"openshift-state-metrics-6b8d965dd5-2cf7r\" (UID: \"5409def3-4053-4c2a-8fae-26b60970c0fc\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" Jun 14 15:57:55.822559 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.822467 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7db11eea-9e0f-49fd-8ffd-0620c1136a10-node-exporter-textfile\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.822559 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.822553 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7db11eea-9e0f-49fd-8ffd-0620c1136a10-sys\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.822779 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.822587 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7db11eea-9e0f-49fd-8ffd-0620c1136a10-root\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.822779 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.822613 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7db11eea-9e0f-49fd-8ffd-0620c1136a10-metrics-client-ca\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.822779 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.822646 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7db11eea-9e0f-49fd-8ffd-0620c1136a10-node-exporter-tls\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.822779 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.822670 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7db11eea-9e0f-49fd-8ffd-0620c1136a10-node-exporter-wtmp\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.822779 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.822702 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7db11eea-9e0f-49fd-8ffd-0620c1136a10-node-exporter-accelerators-collector-config\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.822779 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.822741 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7db11eea-9e0f-49fd-8ffd-0620c1136a10-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.823065 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.822800 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwbjf\" (UniqueName: \"kubernetes.io/projected/7db11eea-9e0f-49fd-8ffd-0620c1136a10-kube-api-access-rwbjf\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.823827 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:55.823402 2528 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 14 15:57:55.823827 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:57:55.823475 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db11eea-9e0f-49fd-8ffd-0620c1136a10-node-exporter-tls podName:7db11eea-9e0f-49fd-8ffd-0620c1136a10 nodeName:}" failed. No retries permitted until 2026-06-14 15:57:56.323454891 +0000 UTC m=+277.253102574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7db11eea-9e0f-49fd-8ffd-0620c1136a10-node-exporter-tls") pod "node-exporter-n69lv" (UID: "7db11eea-9e0f-49fd-8ffd-0620c1136a10") : secret "node-exporter-tls" not found Jun 14 15:57:55.823827 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.823517 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7db11eea-9e0f-49fd-8ffd-0620c1136a10-node-exporter-textfile\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.823827 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.823677 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7db11eea-9e0f-49fd-8ffd-0620c1136a10-node-exporter-wtmp\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.823827 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.823684 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7db11eea-9e0f-49fd-8ffd-0620c1136a10-sys\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.823827 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.823733 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7db11eea-9e0f-49fd-8ffd-0620c1136a10-root\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.824196 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.824154 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7db11eea-9e0f-49fd-8ffd-0620c1136a10-node-exporter-accelerators-collector-config\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.824614 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.824575 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7db11eea-9e0f-49fd-8ffd-0620c1136a10-metrics-client-ca\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.827255 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.827135 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7db11eea-9e0f-49fd-8ffd-0620c1136a10-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:55.833121 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:55.833049 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwbjf\" (UniqueName: \"kubernetes.io/projected/7db11eea-9e0f-49fd-8ffd-0620c1136a10-kube-api-access-rwbjf\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:56.226108 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.226058 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5409def3-4053-4c2a-8fae-26b60970c0fc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-2cf7r\" (UID: \"5409def3-4053-4c2a-8fae-26b60970c0fc\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" Jun 14 15:57:56.229107 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.229044 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5409def3-4053-4c2a-8fae-26b60970c0fc-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-2cf7r\" (UID: \"5409def3-4053-4c2a-8fae-26b60970c0fc\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" Jun 14 15:57:56.327400 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.327365 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7db11eea-9e0f-49fd-8ffd-0620c1136a10-node-exporter-tls\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:56.330066 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.330039 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7db11eea-9e0f-49fd-8ffd-0620c1136a10-node-exporter-tls\") pod \"node-exporter-n69lv\" (UID: \"7db11eea-9e0f-49fd-8ffd-0620c1136a10\") " pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:56.445980 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.445938 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" Jun 14 15:57:56.478601 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.478469 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n69lv" Jun 14 15:57:56.635521 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.634892 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 15:57:56.641397 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.641367 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.644289 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.644261 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 14 15:57:56.644910 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.644807 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 14 15:57:56.645383 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.645352 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 14 15:57:56.645509 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.645371 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 14 15:57:56.646157 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.645887 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-97fx9\"" Jun 14 15:57:56.646157 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.645905 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 14 15:57:56.647808 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.647788 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 14 15:57:56.648256 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.647788 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 14 15:57:56.648678 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.648433 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 14 15:57:56.652788 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.652745 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 14 15:57:56.655349 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.655317 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 15:57:56.731300 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.730759 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.731300 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.730804 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.731300 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.730833 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.731300 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.730863 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbdwn\" (UniqueName: \"kubernetes.io/projected/3a56fbb5-b835-40e7-8257-addf757e45b1-kube-api-access-hbdwn\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.731300 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.730897 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.731300 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.730926 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.731300 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.730956 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.731300 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.731010 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-web-config\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.731300 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.731042 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a56fbb5-b835-40e7-8257-addf757e45b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.731300 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.731072 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a56fbb5-b835-40e7-8257-addf757e45b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.731300 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.731104 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a56fbb5-b835-40e7-8257-addf757e45b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.731300 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.731178 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a56fbb5-b835-40e7-8257-addf757e45b1-config-out\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.731300 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.731208 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a56fbb5-b835-40e7-8257-addf757e45b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.832016 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.831965 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-web-config\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.832206 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.832028 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a56fbb5-b835-40e7-8257-addf757e45b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.832206 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.832057 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a56fbb5-b835-40e7-8257-addf757e45b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.832346 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.832267 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a56fbb5-b835-40e7-8257-addf757e45b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.832402 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.832357 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a56fbb5-b835-40e7-8257-addf757e45b1-config-out\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.832402 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.832392 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a56fbb5-b835-40e7-8257-addf757e45b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.832511 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.832429 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.832511 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.832462 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.832511 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.832487 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.832652 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.832526 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbdwn\" (UniqueName: \"kubernetes.io/projected/3a56fbb5-b835-40e7-8257-addf757e45b1-kube-api-access-hbdwn\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.832652 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.832563 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.832652 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.832583 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a56fbb5-b835-40e7-8257-addf757e45b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.832652 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.832595 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.832833 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.832685 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.834283 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.834194 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a56fbb5-b835-40e7-8257-addf757e45b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.834618 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.834588 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a56fbb5-b835-40e7-8257-addf757e45b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.836973 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.836943 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a56fbb5-b835-40e7-8257-addf757e45b1-config-out\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.837638 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.837605 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.837755 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.837684 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-web-config\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.837932 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.837825 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.838018 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.837951 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.838105 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.838083 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a56fbb5-b835-40e7-8257-addf757e45b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.838669 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.838651 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.839528 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.839477 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.841647 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.841621 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a56fbb5-b835-40e7-8257-addf757e45b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.842535 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.842507 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbdwn\" (UniqueName: \"kubernetes.io/projected/3a56fbb5-b835-40e7-8257-addf757e45b1-kube-api-access-hbdwn\") pod \"alertmanager-main-0\" (UID: \"3a56fbb5-b835-40e7-8257-addf757e45b1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:56.962408 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:56.962368 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 15:57:57.620425 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.620388 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-856c55d9f5-v5gxt"] Jun 14 15:57:57.624608 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.624582 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.626892 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.626856 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wmlch\"" Jun 14 15:57:57.627053 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.626923 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 14 15:57:57.627053 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.626950 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1ubmiptndgp1h\"" Jun 14 15:57:57.627053 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.626956 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 14 15:57:57.627053 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.626995 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 14 15:57:57.627053 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.626952 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 14 15:57:57.627350 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.627326 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 14 15:57:57.637409 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.637313 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-856c55d9f5-v5gxt"] Jun 14 15:57:57.741481 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.741430 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/eeec13cb-d8d1-47e0-9da9-af84d8703f16-secret-thanos-querier-tls\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.741481 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.741481 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeec13cb-d8d1-47e0-9da9-af84d8703f16-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.741729 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.741523 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eeec13cb-d8d1-47e0-9da9-af84d8703f16-secret-grpc-tls\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.741729 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.741587 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/eeec13cb-d8d1-47e0-9da9-af84d8703f16-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.741729 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.741631 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjczq\" (UniqueName: \"kubernetes.io/projected/eeec13cb-d8d1-47e0-9da9-af84d8703f16-kube-api-access-vjczq\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.741729 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.741669 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeec13cb-d8d1-47e0-9da9-af84d8703f16-metrics-client-ca\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.741906 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.741823 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeec13cb-d8d1-47e0-9da9-af84d8703f16-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.741906 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.741876 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/eeec13cb-d8d1-47e0-9da9-af84d8703f16-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.842898 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.842856 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eeec13cb-d8d1-47e0-9da9-af84d8703f16-secret-grpc-tls\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.843099 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.842917 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/eeec13cb-d8d1-47e0-9da9-af84d8703f16-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.843099 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.842954 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjczq\" (UniqueName: \"kubernetes.io/projected/eeec13cb-d8d1-47e0-9da9-af84d8703f16-kube-api-access-vjczq\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.843099 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.842989 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeec13cb-d8d1-47e0-9da9-af84d8703f16-metrics-client-ca\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.843099 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.843090 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeec13cb-d8d1-47e0-9da9-af84d8703f16-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.843321 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.843128 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/eeec13cb-d8d1-47e0-9da9-af84d8703f16-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.843321 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.843161 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/eeec13cb-d8d1-47e0-9da9-af84d8703f16-secret-thanos-querier-tls\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.843423 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.843347 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeec13cb-d8d1-47e0-9da9-af84d8703f16-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.844078 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.844024 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeec13cb-d8d1-47e0-9da9-af84d8703f16-metrics-client-ca\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.846490 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.846335 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eeec13cb-d8d1-47e0-9da9-af84d8703f16-secret-grpc-tls\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.846490 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.846439 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/eeec13cb-d8d1-47e0-9da9-af84d8703f16-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.846490 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.846467 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeec13cb-d8d1-47e0-9da9-af84d8703f16-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.846742 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.846572 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeec13cb-d8d1-47e0-9da9-af84d8703f16-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.847239 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.847191 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/eeec13cb-d8d1-47e0-9da9-af84d8703f16-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.847707 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.847678 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/eeec13cb-d8d1-47e0-9da9-af84d8703f16-secret-thanos-querier-tls\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.850866 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.850841 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjczq\" (UniqueName: \"kubernetes.io/projected/eeec13cb-d8d1-47e0-9da9-af84d8703f16-kube-api-access-vjczq\") pod \"thanos-querier-856c55d9f5-v5gxt\" (UID: \"eeec13cb-d8d1-47e0-9da9-af84d8703f16\") " pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:57.937052 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:57.937012 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:57:59.863872 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:59.863833 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-d64d84bff-hfv4c"] Jun 14 15:57:59.867425 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:59.867388 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:57:59.871284 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:59.870494 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 14 15:57:59.871284 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:59.870756 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9omk65ce6snui\"" Jun 14 15:57:59.871284 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:59.871008 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 14 15:57:59.871284 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:59.871243 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 14 15:57:59.871586 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:59.871379 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 14 15:57:59.871586 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:59.871450 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-w4q8s\"" Jun 14 15:57:59.884557 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:59.884525 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d64d84bff-hfv4c"] Jun 14 15:57:59.966359 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:59.966317 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdwgr\" (UniqueName: \"kubernetes.io/projected/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-kube-api-access-zdwgr\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:57:59.966556 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:59.966372 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-secret-metrics-server-tls\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:57:59.966556 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:59.966425 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-secret-metrics-server-client-certs\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:57:59.966556 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:59.966463 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:57:59.966556 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:59.966521 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-client-ca-bundle\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:57:59.966556 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:59.966539 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-audit-log\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:57:59.966825 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:57:59.966573 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-metrics-server-audit-profiles\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:00.067328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.067291 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdwgr\" (UniqueName: \"kubernetes.io/projected/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-kube-api-access-zdwgr\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:00.067328 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.067333 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-secret-metrics-server-tls\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:00.067577 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.067361 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-secret-metrics-server-client-certs\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:00.067577 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.067391 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:00.067577 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.067444 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-client-ca-bundle\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:00.067577 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.067478 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-audit-log\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:00.067577 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.067502 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-metrics-server-audit-profiles\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:00.068199 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.068134 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-audit-log\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:00.068455 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.068432 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:00.069059 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.069033 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-metrics-server-audit-profiles\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:00.070515 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.070477 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-secret-metrics-server-tls\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:00.070643 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.070591 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-secret-metrics-server-client-certs\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:00.070722 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.070670 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-client-ca-bundle\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:00.075204 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.075181 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdwgr\" (UniqueName: \"kubernetes.io/projected/4f9a779f-2ffc-4f22-bde4-e6d434754e3c-kube-api-access-zdwgr\") pod \"metrics-server-d64d84bff-hfv4c\" (UID: \"4f9a779f-2ffc-4f22-bde4-e6d434754e3c\") " pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:00.183454 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.183418 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:00.323412 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.323374 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-h7stp"] Jun 14 15:58:00.327025 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.326999 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7stp" Jun 14 15:58:00.329000 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.328976 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8fg4p\"" Jun 14 15:58:00.329147 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.328977 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 14 15:58:00.334878 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.334809 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-h7stp"] Jun 14 15:58:00.472428 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.472270 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqh86\" (UniqueName: \"kubernetes.io/projected/68e8d5a6-e1f4-474c-8339-6c53500da532-kube-api-access-gqh86\") pod \"monitoring-plugin-589576dfc7-h7stp\" (UID: \"68e8d5a6-e1f4-474c-8339-6c53500da532\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7stp" Jun 14 15:58:00.472428 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.472329 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/68e8d5a6-e1f4-474c-8339-6c53500da532-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-h7stp\" (UID: \"68e8d5a6-e1f4-474c-8339-6c53500da532\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7stp" Jun 14 15:58:00.573805 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.573767 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqh86\" (UniqueName: \"kubernetes.io/projected/68e8d5a6-e1f4-474c-8339-6c53500da532-kube-api-access-gqh86\") pod \"monitoring-plugin-589576dfc7-h7stp\" (UID: \"68e8d5a6-e1f4-474c-8339-6c53500da532\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7stp" Jun 14 15:58:00.573997 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.573819 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/68e8d5a6-e1f4-474c-8339-6c53500da532-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-h7stp\" (UID: \"68e8d5a6-e1f4-474c-8339-6c53500da532\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7stp" Jun 14 15:58:00.574062 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:58:00.574026 2528 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 14 15:58:00.574114 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:58:00.574084 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68e8d5a6-e1f4-474c-8339-6c53500da532-monitoring-plugin-cert podName:68e8d5a6-e1f4-474c-8339-6c53500da532 nodeName:}" failed. No retries permitted until 2026-06-14 15:58:01.074066942 +0000 UTC m=+282.003714619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/68e8d5a6-e1f4-474c-8339-6c53500da532-monitoring-plugin-cert") pod "monitoring-plugin-589576dfc7-h7stp" (UID: "68e8d5a6-e1f4-474c-8339-6c53500da532") : secret "monitoring-plugin-cert" not found Jun 14 15:58:00.582794 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:00.582757 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqh86\" (UniqueName: \"kubernetes.io/projected/68e8d5a6-e1f4-474c-8339-6c53500da532-kube-api-access-gqh86\") pod \"monitoring-plugin-589576dfc7-h7stp\" (UID: \"68e8d5a6-e1f4-474c-8339-6c53500da532\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7stp" Jun 14 15:58:01.080436 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.078548 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/68e8d5a6-e1f4-474c-8339-6c53500da532-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-h7stp\" (UID: \"68e8d5a6-e1f4-474c-8339-6c53500da532\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7stp" Jun 14 15:58:01.092261 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.092183 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/68e8d5a6-e1f4-474c-8339-6c53500da532-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-h7stp\" (UID: \"68e8d5a6-e1f4-474c-8339-6c53500da532\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7stp" Jun 14 15:58:01.116274 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:58:01.116184 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jb9fb" podUID="50821ade-1839-41ad-9c07-4b1316d44359" Jun 14 15:58:01.119990 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:58:01.119928 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" podUID="79a3acdf-c409-4e2d-8e7f-5a3af205008e" Jun 14 15:58:01.200423 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.200384 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 15:58:01.202127 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:58:01.202096 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a56fbb5_b835_40e7_8257_addf757e45b1.slice/crio-840b38e62685dd6e1a4d2da153e59a78e9e93d6d57ad7f50d47a02474c0e66db WatchSource:0}: Error finding container 840b38e62685dd6e1a4d2da153e59a78e9e93d6d57ad7f50d47a02474c0e66db: Status 404 returned error can't find the container with id 840b38e62685dd6e1a4d2da153e59a78e9e93d6d57ad7f50d47a02474c0e66db Jun 14 15:58:01.239691 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.239660 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7stp" Jun 14 15:58:01.380125 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.380088 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-h7stp"] Jun 14 15:58:01.384110 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:58:01.384077 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e8d5a6_e1f4_474c_8339_6c53500da532.slice/crio-5f72a2fd84c437c71bb2c01f52a74259039c237237c931b2d8303341d968e0b1 WatchSource:0}: Error finding container 5f72a2fd84c437c71bb2c01f52a74259039c237237c931b2d8303341d968e0b1: Status 404 returned error can't find the container with id 5f72a2fd84c437c71bb2c01f52a74259039c237237c931b2d8303341d968e0b1 Jun 14 15:58:01.415780 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.415675 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r"] Jun 14 15:58:01.418578 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.418522 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d64d84bff-hfv4c"] Jun 14 15:58:01.422084 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.422048 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-856c55d9f5-v5gxt"] Jun 14 15:58:01.424827 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:58:01.424783 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f9a779f_2ffc_4f22_bde4_e6d434754e3c.slice/crio-68282d5a5e56a1e037fcb22c5214d03a5e0f7b7006b23fde6fee8c13e5d28596 WatchSource:0}: Error finding container 68282d5a5e56a1e037fcb22c5214d03a5e0f7b7006b23fde6fee8c13e5d28596: Status 404 returned error can't find the container with id 68282d5a5e56a1e037fcb22c5214d03a5e0f7b7006b23fde6fee8c13e5d28596 Jun 14 15:58:01.425700 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:58:01.425573 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeec13cb_d8d1_47e0_9da9_af84d8703f16.slice/crio-9c4c401e2a6d2f1da2960bee9461a2aacc54abca1d84905a4f8fe22f91f1fdbf WatchSource:0}: Error finding container 9c4c401e2a6d2f1da2960bee9461a2aacc54abca1d84905a4f8fe22f91f1fdbf: Status 404 returned error can't find the container with id 9c4c401e2a6d2f1da2960bee9461a2aacc54abca1d84905a4f8fe22f91f1fdbf Jun 14 15:58:01.521575 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.521475 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7stp" event={"ID":"68e8d5a6-e1f4-474c-8339-6c53500da532","Type":"ContainerStarted","Data":"5f72a2fd84c437c71bb2c01f52a74259039c237237c931b2d8303341d968e0b1"} Jun 14 15:58:01.523269 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.523237 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n69lv" event={"ID":"7db11eea-9e0f-49fd-8ffd-0620c1136a10","Type":"ContainerStarted","Data":"aad9500aaccabf3125a0511a17506de567c60bdefbf46373904a8fd5a54f3658"} Jun 14 15:58:01.526124 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.526079 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-mbthr" event={"ID":"a3edf5cf-6899-4036-9266-284f0fa2eb11","Type":"ContainerStarted","Data":"d4fda76fad043cac821257616fe47409c6a34a13cb98cd280da6814e9e876b63"} Jun 14 15:58:01.526757 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.526732 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-mbthr" Jun 14 15:58:01.529587 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.529554 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" event={"ID":"5409def3-4053-4c2a-8fae-26b60970c0fc","Type":"ContainerStarted","Data":"b854cd140a90102ed5bee2e2e92a8fcd91cb53a71fafbfc08bc229986cb5bd99"} Jun 14 15:58:01.529728 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.529635 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" event={"ID":"5409def3-4053-4c2a-8fae-26b60970c0fc","Type":"ContainerStarted","Data":"d8d59ac6b0d3be7b8fa5e0e354a46c0c519f330862672f5d8fcfc27ac1cc00b4"} Jun 14 15:58:01.532673 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.532526 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a56fbb5-b835-40e7-8257-addf757e45b1","Type":"ContainerStarted","Data":"840b38e62685dd6e1a4d2da153e59a78e9e93d6d57ad7f50d47a02474c0e66db"} Jun 14 15:58:01.533517 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.533470 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-mbthr" Jun 14 15:58:01.535599 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.535505 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" event={"ID":"eeec13cb-d8d1-47e0-9da9-af84d8703f16","Type":"ContainerStarted","Data":"9c4c401e2a6d2f1da2960bee9461a2aacc54abca1d84905a4f8fe22f91f1fdbf"} Jun 14 15:58:01.539055 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.538698 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:58:01.539055 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.538994 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jb9fb" Jun 14 15:58:01.539622 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.539392 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" event={"ID":"4f9a779f-2ffc-4f22-bde4-e6d434754e3c","Type":"ContainerStarted","Data":"68282d5a5e56a1e037fcb22c5214d03a5e0f7b7006b23fde6fee8c13e5d28596"} Jun 14 15:58:01.545501 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.545402 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-mbthr" podStartSLOduration=1.668129594 podStartE2EDuration="18.545378382s" totalImagesPullingTime="16.877248788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:57:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:58:01.544739107 +0000 UTC m=+282.474386802" watchObservedRunningTime="2026-06-14 15:58:01.545378382 +0000 UTC m=+282.475026079" Jun 14 15:58:01.952042 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.951999 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 15:58:01.957958 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.957920 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:01.963259 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.962006 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 14 15:58:01.963259 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.962294 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1f62spv1r72ao\"" Jun 14 15:58:01.963259 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.962502 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 14 15:58:01.963259 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.962701 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 14 15:58:01.963259 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.962991 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 14 15:58:01.963632 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.963546 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 14 15:58:01.964406 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.964379 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vq7nt\"" Jun 14 15:58:01.964724 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.964702 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 14 15:58:01.965102 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.965073 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 14 15:58:01.967427 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.965292 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 14 15:58:01.967427 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.965495 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 14 15:58:01.967427 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.965672 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 14 15:58:01.968254 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.967677 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 14 15:58:01.968636 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.968416 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 14 15:58:01.969109 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:01.969032 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 14 15:58:02.004559 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.004363 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 15:58:02.025768 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.025723 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 14 15:58:02.101254 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.100969 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.101254 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.101067 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-web-config\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.101254 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.101099 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.101254 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.101150 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.102291 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.101186 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc7df\" (UniqueName: \"kubernetes.io/projected/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-kube-api-access-sc7df\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.102291 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.102081 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.102291 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.102112 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.102291 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.102143 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.102291 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.102176 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.103182 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.102205 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.103182 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.102686 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.103182 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.102727 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.103182 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.102753 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-config-out\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.103182 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.102774 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.103182 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.102835 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.103182 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.102858 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.103182 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.102885 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-config\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.103182 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.102907 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.103182 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.102937 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.103182 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.102961 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.203826 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.203734 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-web-config\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.203826 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.203797 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.204048 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.203857 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.204048 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.203897 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc7df\" (UniqueName: \"kubernetes.io/projected/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-kube-api-access-sc7df\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.204048 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.203949 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.204048 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.203977 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.204048 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.204009 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.204048 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.204037 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.204386 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.204072 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.204386 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.204105 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.204386 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.204138 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.204386 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.204164 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-config-out\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.204386 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.204186 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.204386 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.204277 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.204386 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.204304 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.204386 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.204332 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-config\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.204386 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.204355 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.204386 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.204387 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.204881 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.204419 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.204881 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.204446 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.210281 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.206691 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.210281 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.208562 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.211803 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.211127 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.211803 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.211459 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.215320 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.215285 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.216268 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.216241 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.217118 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.217090 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.217850 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.217819 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.234069 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.233993 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc7df\" (UniqueName: \"kubernetes.io/projected/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-kube-api-access-sc7df\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.236978 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.236908 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.246260 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.245742 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.252708 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.252630 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.252708 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.252660 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-web-config\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.253031 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.252922 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-config-out\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.253516 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.253460 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.254083 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.254034 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.254465 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.254389 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.259203 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.259075 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.264101 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.263963 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.264101 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.264045 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a07e7acc-e11e-46b2-ae2a-72bc71f36cf5-config\") pod \"prometheus-k8s-0\" (UID: \"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.307144 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.305694 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:02.555791 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.555755 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 14 15:58:02.562298 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:58:02.562260 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda07e7acc_e11e_46b2_ae2a_72bc71f36cf5.slice/crio-d6f9636b5e56cf7afd9db3d71c8c0ce7d3a3a7bb82dc7826ac041a1923374a05 WatchSource:0}: Error finding container d6f9636b5e56cf7afd9db3d71c8c0ce7d3a3a7bb82dc7826ac041a1923374a05: Status 404 returned error can't find the container with id d6f9636b5e56cf7afd9db3d71c8c0ce7d3a3a7bb82dc7826ac041a1923374a05 Jun 14 15:58:02.572310 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:02.572275 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" event={"ID":"5409def3-4053-4c2a-8fae-26b60970c0fc","Type":"ContainerStarted","Data":"1a1914cf137beef35e1ff195809fade471529ddbe37f59ca8136783e25f38316"} Jun 14 15:58:03.582943 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:03.582903 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5","Type":"ContainerStarted","Data":"d6f9636b5e56cf7afd9db3d71c8c0ce7d3a3a7bb82dc7826ac041a1923374a05"} Jun 14 15:58:04.442076 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:04.442022 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:58:04.442300 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:04.442094 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:58:04.445942 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:04.445876 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/50821ade-1839-41ad-9c07-4b1316d44359-metrics-tls\") pod \"dns-default-jb9fb\" (UID: \"50821ade-1839-41ad-9c07-4b1316d44359\") " pod="openshift-dns/dns-default-jb9fb" Jun 14 15:58:04.447031 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:04.446994 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls\") pod \"image-registry-5467bb9bd-rtrsb\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:58:04.542493 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:04.542265 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-drg75\"" Jun 14 15:58:04.542493 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:04.542264 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sj9hl\"" Jun 14 15:58:04.551391 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:04.551100 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jb9fb" Jun 14 15:58:04.551391 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:04.551264 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:58:07.459621 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:07.455790 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5467bb9bd-rtrsb"] Jun 14 15:58:07.480426 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:07.480385 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jb9fb"] Jun 14 15:58:07.495001 ip-10-0-143-112 kubenswrapper[2528]: W0614 15:58:07.492873 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50821ade_1839_41ad_9c07_4b1316d44359.slice/crio-cd1d10b9ecb49e997793b753a00e866f0f2284c9160325f0bb726e710e39187b WatchSource:0}: Error finding container cd1d10b9ecb49e997793b753a00e866f0f2284c9160325f0bb726e710e39187b: Status 404 returned error can't find the container with id cd1d10b9ecb49e997793b753a00e866f0f2284c9160325f0bb726e710e39187b Jun 14 15:58:07.608479 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:07.607146 2528 generic.go:356] "Generic (PLEG): container finished" podID="3a56fbb5-b835-40e7-8257-addf757e45b1" containerID="63d76cc8ec7088cf8fb23dba64a9d27c595b311963a73ad7a7efc6ce4e46c9d5" exitCode=0 Jun 14 15:58:07.608479 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:07.607268 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a56fbb5-b835-40e7-8257-addf757e45b1","Type":"ContainerDied","Data":"63d76cc8ec7088cf8fb23dba64a9d27c595b311963a73ad7a7efc6ce4e46c9d5"} Jun 14 15:58:07.610302 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:07.609782 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" event={"ID":"eeec13cb-d8d1-47e0-9da9-af84d8703f16","Type":"ContainerStarted","Data":"7e90db88782107d6ee5e87575e911076ad3d2c93fb4b5a003b73a6853a58844e"} Jun 14 15:58:07.616740 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:07.616704 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" event={"ID":"4f9a779f-2ffc-4f22-bde4-e6d434754e3c","Type":"ContainerStarted","Data":"ebdda4242d7e4486f105fd9b8025d3a4ca65c99ad2bdb59fa59f4b2c69015b2f"} Jun 14 15:58:07.619571 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:07.619540 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jb9fb" event={"ID":"50821ade-1839-41ad-9c07-4b1316d44359","Type":"ContainerStarted","Data":"cd1d10b9ecb49e997793b753a00e866f0f2284c9160325f0bb726e710e39187b"} Jun 14 15:58:07.621434 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:07.621408 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" event={"ID":"79a3acdf-c409-4e2d-8e7f-5a3af205008e","Type":"ContainerStarted","Data":"ad93d2d282ef99af1a9d9bbc2424fb56f2030eb0072fa662983a349a3fb1c012"} Jun 14 15:58:07.623459 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:07.623437 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7stp" event={"ID":"68e8d5a6-e1f4-474c-8339-6c53500da532","Type":"ContainerStarted","Data":"e7f77e41fdd19c87cf67619a5c33e1730daee61fd725e04531a3a22526f021f1"} Jun 14 15:58:07.624185 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:07.624167 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7stp" Jun 14 15:58:07.626781 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:07.626758 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n69lv" event={"ID":"7db11eea-9e0f-49fd-8ffd-0620c1136a10","Type":"ContainerStarted","Data":"d35ee3858a2f96087dd51f7d1f218a83f30e89a9507a139b27522a7ab4d87f59"} Jun 14 15:58:07.637163 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:07.637128 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7stp" Jun 14 15:58:07.663596 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:07.662699 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7stp" podStartSLOduration=1.690699309 podStartE2EDuration="7.662674676s" totalImagesPullingTime="5.971975367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:58:07.659913497 +0000 UTC m=+288.589561196" watchObservedRunningTime="2026-06-14 15:58:07.662674676 +0000 UTC m=+288.592322373" Jun 14 15:58:07.715377 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:07.715301 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" podStartSLOduration=2.786964044 podStartE2EDuration="8.715262123s" totalImagesPullingTime="5.928298079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:58:07.713338243 +0000 UTC m=+288.642985941" watchObservedRunningTime="2026-06-14 15:58:07.715262123 +0000 UTC m=+288.644909819" Jun 14 15:58:08.638945 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:08.638781 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" event={"ID":"eeec13cb-d8d1-47e0-9da9-af84d8703f16","Type":"ContainerStarted","Data":"6006810dd1a8f0e4c649ea4c0d97072a4c25a981ba5992dd335c5235cf374b63"} Jun 14 15:58:08.638945 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:08.638875 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" event={"ID":"eeec13cb-d8d1-47e0-9da9-af84d8703f16","Type":"ContainerStarted","Data":"d67896dac5bfd4344c7816d8b80076403da7a9f83ee4ab49b532ff9b5474024c"} Jun 14 15:58:08.642768 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:08.642637 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" event={"ID":"79a3acdf-c409-4e2d-8e7f-5a3af205008e","Type":"ContainerStarted","Data":"69a6bca07a8a109c5fbd9a771e8587f8cbe9a99ae80796584b6cb25a991b0001"} Jun 14 15:58:08.642768 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:08.642724 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:58:08.645055 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:08.644867 2528 generic.go:356] "Generic (PLEG): container finished" podID="a07e7acc-e11e-46b2-ae2a-72bc71f36cf5" containerID="1093621a36527cfbc5c6c749da3cd33b6f6057b53ffc13f3d49ef36b8e218978" exitCode=0 Jun 14 15:58:08.645055 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:08.644976 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5","Type":"ContainerDied","Data":"1093621a36527cfbc5c6c749da3cd33b6f6057b53ffc13f3d49ef36b8e218978"} Jun 14 15:58:08.648984 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:08.648951 2528 generic.go:356] "Generic (PLEG): container finished" podID="7db11eea-9e0f-49fd-8ffd-0620c1136a10" containerID="d35ee3858a2f96087dd51f7d1f218a83f30e89a9507a139b27522a7ab4d87f59" exitCode=0 Jun 14 15:58:08.649096 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:08.649057 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n69lv" event={"ID":"7db11eea-9e0f-49fd-8ffd-0620c1136a10","Type":"ContainerDied","Data":"d35ee3858a2f96087dd51f7d1f218a83f30e89a9507a139b27522a7ab4d87f59"} Jun 14 15:58:08.655955 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:08.655597 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" event={"ID":"5409def3-4053-4c2a-8fae-26b60970c0fc","Type":"ContainerStarted","Data":"70eef569399d1b04d9b67d09a2a4bfcdf88372af1ea2431249276dfdb61283b9"} Jun 14 15:58:08.664350 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:08.664291 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" podStartSLOduration=288.664271066 podStartE2EDuration="4m48.664271066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:53:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:58:08.662539514 +0000 UTC m=+289.592187216" watchObservedRunningTime="2026-06-14 15:58:08.664271066 +0000 UTC m=+289.593918767" Jun 14 15:58:08.729070 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:08.726558 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-2cf7r" podStartSLOduration=7.9883845959999995 podStartE2EDuration="13.726536321s" totalImagesPullingTime="5.738151725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:57:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:58:08.725039501 +0000 UTC m=+289.654687197" watchObservedRunningTime="2026-06-14 15:58:08.726536321 +0000 UTC m=+289.656184017" Jun 14 15:58:11.670906 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:11.670866 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a56fbb5-b835-40e7-8257-addf757e45b1","Type":"ContainerStarted","Data":"2255d121b871d76f55d8a66e58ea67d5e3606728962e40fac5c7902daac02d6f"} Jun 14 15:58:11.673708 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:11.673672 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" event={"ID":"eeec13cb-d8d1-47e0-9da9-af84d8703f16","Type":"ContainerStarted","Data":"7e03403d943bd79baac4aaa4f524ebf05258a160822d055eb2a6788c73802202"} Jun 14 15:58:11.675281 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:11.675248 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jb9fb" event={"ID":"50821ade-1839-41ad-9c07-4b1316d44359","Type":"ContainerStarted","Data":"05daa71f9a960e614b1820fd7764a5ba01636cba69f982290baac9afb99f9e92"} Jun 14 15:58:11.677556 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:11.677528 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n69lv" event={"ID":"7db11eea-9e0f-49fd-8ffd-0620c1136a10","Type":"ContainerStarted","Data":"c85c7a8dc639df146a0d6c57932b7ace53a82f2b473e94b3f40478ed3cc17a32"} Jun 14 15:58:11.677692 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:11.677583 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n69lv" event={"ID":"7db11eea-9e0f-49fd-8ffd-0620c1136a10","Type":"ContainerStarted","Data":"93a2d12a1acea99799e4e063cd2a07a809b72eec82b9b30e7f0234daa21e2c7f"} Jun 14 15:58:11.697146 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:11.697079 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n69lv" podStartSLOduration=10.374436907 podStartE2EDuration="16.697058263s" totalImagesPullingTime="6.179892738s" totalInitContainerRuntime="142.728618ms" isStatefulPod=true podCreationTimestamp="2026-06-14 15:57:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:58:11.696331626 +0000 UTC m=+292.625979347" watchObservedRunningTime="2026-06-14 15:58:11.697058263 +0000 UTC m=+292.626705959" Jun 14 15:58:12.685778 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:12.685745 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a56fbb5-b835-40e7-8257-addf757e45b1","Type":"ContainerStarted","Data":"b86f1cad979446051231b0458e12a60cedc8ebf8bd8b58d4e4d4163f49a77871"} Jun 14 15:58:12.686149 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:12.685827 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a56fbb5-b835-40e7-8257-addf757e45b1","Type":"ContainerStarted","Data":"b93157985f9f44f581639f5f19ee3b122456e92bcb57bdd13cb861d5573cf510"} Jun 14 15:58:12.689364 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:12.689330 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" event={"ID":"eeec13cb-d8d1-47e0-9da9-af84d8703f16","Type":"ContainerStarted","Data":"8e3de65c92c4cba047f568de688866971cefb141d7def66c079029187b63e674"} Jun 14 15:58:12.689523 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:12.689417 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" event={"ID":"eeec13cb-d8d1-47e0-9da9-af84d8703f16","Type":"ContainerStarted","Data":"36649c1e135a0bb4c41c06e5fe6728fd31928d65e430a31c360799126626df55"} Jun 14 15:58:12.689616 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:12.689599 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:58:12.691268 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:12.691240 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jb9fb" event={"ID":"50821ade-1839-41ad-9c07-4b1316d44359","Type":"ContainerStarted","Data":"44e50128eb9c9cec60b6b18d19df35e8d058123b50326d7f8bb76e471270ecd6"} Jun 14 15:58:12.691560 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:12.691536 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jb9fb" Jun 14 15:58:12.696187 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:12.696164 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" Jun 14 15:58:12.714419 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:12.714375 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-856c55d9f5-v5gxt" podStartSLOduration=6.893663365 podStartE2EDuration="15.714350912s" totalImagesPullingTime="8.820687547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:57:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:58:12.712539084 +0000 UTC m=+293.642186776" watchObservedRunningTime="2026-06-14 15:58:12.714350912 +0000 UTC m=+293.643998610" Jun 14 15:58:12.728442 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:12.728390 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jb9fb" podStartSLOduration=255.350438305 podStartE2EDuration="4m18.728371974s" totalImagesPullingTime="3.377933669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 15:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:58:12.727184963 +0000 UTC m=+293.656832658" watchObservedRunningTime="2026-06-14 15:58:12.728371974 +0000 UTC m=+293.658019669" Jun 14 15:58:13.699950 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:13.699909 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a56fbb5-b835-40e7-8257-addf757e45b1","Type":"ContainerStarted","Data":"de85b6ce7bf148f8b2e634df2c21a917d27cd04d9f27ee08e28f0fe425c7ec1a"} Jun 14 15:58:13.700773 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:13.700748 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a56fbb5-b835-40e7-8257-addf757e45b1","Type":"ContainerStarted","Data":"477bfc1676d846c7dfe225048ce9f3998fe139c3abf627a568fdf5e607c33483"} Jun 14 15:58:13.700975 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:13.700961 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a56fbb5-b835-40e7-8257-addf757e45b1","Type":"ContainerStarted","Data":"cf0231a134bd7b86d80ecaf0d49b75a0ed4475d8be7f486ce15ea97ee09cc994"} Jun 14 15:58:13.704735 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:13.704683 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5","Type":"ContainerStarted","Data":"71f5b1fdeaf591c494ed598ad12a0f79fe7a1559860dd8df82410ed9bfef6bd2"} Jun 14 15:58:13.704919 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:13.704765 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5","Type":"ContainerStarted","Data":"b51d3b37bca0250ebaf5b8f786d038687b34e55b75bb54b553e7ad706f369af1"} Jun 14 15:58:13.704919 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:13.704806 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5","Type":"ContainerStarted","Data":"d18e4a0c03244de0ccfec533eee571cce84233831c33f2a2eddc0adee6fcabd7"} Jun 14 15:58:13.704919 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:13.704841 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5","Type":"ContainerStarted","Data":"26ff70a9df8e37f43b119b78ccefe4c3021c71ba90a129f7842ec5cd2deeaa8e"} Jun 14 15:58:13.704919 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:13.704867 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5","Type":"ContainerStarted","Data":"04331e0d3208edd8a63b1fdd0bc15f4df83581917b0ab928743ee021dce169df"} Jun 14 15:58:13.704919 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:13.704891 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a07e7acc-e11e-46b2-ae2a-72bc71f36cf5","Type":"ContainerStarted","Data":"7c5c0802c567cb577ba3965356fb1134d63025651844af67efa6f52bd1f0bbda"} Jun 14 15:58:13.727236 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:13.727153 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.37473838 podStartE2EDuration="17.727127632s" totalImagesPullingTime="9.338779794s" totalInitContainerRuntime="13.609458ms" isStatefulPod=false podCreationTimestamp="2026-06-14 15:57:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:58:13.72428132 +0000 UTC m=+294.653929017" watchObservedRunningTime="2026-06-14 15:58:13.727127632 +0000 UTC m=+294.656775327" Jun 14 15:58:13.752251 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:13.751934 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.962910477 podStartE2EDuration="12.751913043s" totalImagesPullingTime="8.754643535s" totalInitContainerRuntime="34.359031ms" isStatefulPod=false podCreationTimestamp="2026-06-14 15:58:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 15:58:13.751258009 +0000 UTC m=+294.680905705" watchObservedRunningTime="2026-06-14 15:58:13.751913043 +0000 UTC m=+294.681560740" Jun 14 15:58:17.306860 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:17.306807 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:58:19.539340 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:19.539312 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b5tmd_80523acb-bab6-4e11-83b3-35af2852be80/console-operator/1.log" Jun 14 15:58:19.539807 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:19.539389 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b5tmd_80523acb-bab6-4e11-83b3-35af2852be80/console-operator/1.log" Jun 14 15:58:19.549145 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:19.549118 2528 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 15:58:20.183909 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:20.183870 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:20.201492 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:20.183956 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:22.707504 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:22.707471 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jb9fb" Jun 14 15:58:24.555909 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:24.555871 2528 patch_prober.go:28] interesting pod/image-registry-5467bb9bd-rtrsb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 15:58:24.556341 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:24.555928 2528 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" podUID="79a3acdf-c409-4e2d-8e7f-5a3af205008e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 15:58:30.669402 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:30.669367 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:58:34.273993 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:34.273953 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5467bb9bd-rtrsb"] Jun 14 15:58:37.815519 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:37.815479 2528 generic.go:356] "Generic (PLEG): container finished" podID="26897061-21eb-4b9e-a798-f8d22f6005a5" containerID="8f6d9958767415e0f9ab9aa5434adaaca41527190e84b74b4ff1d1cc98334785" exitCode=0 Jun 14 15:58:37.815978 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:37.815551 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" event={"ID":"26897061-21eb-4b9e-a798-f8d22f6005a5","Type":"ContainerDied","Data":"8f6d9958767415e0f9ab9aa5434adaaca41527190e84b74b4ff1d1cc98334785"} Jun 14 15:58:37.815978 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:37.815971 2528 scope.go:117] "RemoveContainer" containerID="8f6d9958767415e0f9ab9aa5434adaaca41527190e84b74b4ff1d1cc98334785" Jun 14 15:58:37.817276 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:37.817252 2528 generic.go:356] "Generic (PLEG): container finished" podID="ba7e3f8c-371f-448a-939c-3d88290bbeda" containerID="5d9d7a0a1bff70ef92ad3082dbc2c08ff71cc7ab1dd6cabf78ca70aed4184f94" exitCode=0 Jun 14 15:58:37.817383 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:37.817289 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz" event={"ID":"ba7e3f8c-371f-448a-939c-3d88290bbeda","Type":"ContainerDied","Data":"5d9d7a0a1bff70ef92ad3082dbc2c08ff71cc7ab1dd6cabf78ca70aed4184f94"} Jun 14 15:58:37.817570 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:37.817558 2528 scope.go:117] "RemoveContainer" containerID="5d9d7a0a1bff70ef92ad3082dbc2c08ff71cc7ab1dd6cabf78ca70aed4184f94" Jun 14 15:58:38.823402 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:38.823354 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-hsvlk" event={"ID":"26897061-21eb-4b9e-a798-f8d22f6005a5","Type":"ContainerStarted","Data":"9bceeeebf81570245d6c1f2deb2f2e7596f48ebba107da81de3aac4b2e44bfd8"} Jun 14 15:58:38.825314 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:38.825287 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-nhxvz" event={"ID":"ba7e3f8c-371f-448a-939c-3d88290bbeda","Type":"ContainerStarted","Data":"22016ef8d6cb1f01728e164675bb3caf97e89cb596914ddab96944098c42d95b"} Jun 14 15:58:40.189903 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:40.189873 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:40.193900 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:40.193880 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-d64d84bff-hfv4c" Jun 14 15:58:42.843758 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:42.843683 2528 generic.go:356] "Generic (PLEG): container finished" podID="ecd58d5a-c77a-4130-9a10-b8869428bf6d" containerID="f3c88daa53ac7e76cf684a65e2235a6604b66d2b3ff9d1a9badf194aa65ced86" exitCode=0 Jun 14 15:58:42.844099 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:42.843762 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6" event={"ID":"ecd58d5a-c77a-4130-9a10-b8869428bf6d","Type":"ContainerDied","Data":"f3c88daa53ac7e76cf684a65e2235a6604b66d2b3ff9d1a9badf194aa65ced86"} Jun 14 15:58:42.844142 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:42.844125 2528 scope.go:117] "RemoveContainer" containerID="f3c88daa53ac7e76cf684a65e2235a6604b66d2b3ff9d1a9badf194aa65ced86" Jun 14 15:58:43.850316 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:43.850283 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5v2h6" event={"ID":"ecd58d5a-c77a-4130-9a10-b8869428bf6d","Type":"ContainerStarted","Data":"e2171c3fbda72ae38c6ba0293d7073a2c2dac707363564327303c20802148b63"} Jun 14 15:58:59.298009 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:58:59.297939 2528 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" podUID="79a3acdf-c409-4e2d-8e7f-5a3af205008e" containerName="registry" containerID="cri-o://69a6bca07a8a109c5fbd9a771e8587f8cbe9a99ae80796584b6cb25a991b0001" gracePeriod=30 Jun 14 15:59:00.648257 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.648186 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:59:00.729117 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.729021 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls\") pod \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " Jun 14 15:59:00.729117 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.729096 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-certificates\") pod \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " Jun 14 15:59:00.729389 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.729136 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79a3acdf-c409-4e2d-8e7f-5a3af205008e-ca-trust-extracted\") pod \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " Jun 14 15:59:00.729389 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.729164 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgx66\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-kube-api-access-sgx66\") pod \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " Jun 14 15:59:00.729389 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.729196 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79a3acdf-c409-4e2d-8e7f-5a3af205008e-installation-pull-secrets\") pod \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " Jun 14 15:59:00.729389 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.729279 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-bound-sa-token\") pod \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " Jun 14 15:59:00.729389 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.729350 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79a3acdf-c409-4e2d-8e7f-5a3af205008e-trusted-ca\") pod \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " Jun 14 15:59:00.729649 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.729445 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79a3acdf-c409-4e2d-8e7f-5a3af205008e-image-registry-private-configuration\") pod \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\" (UID: \"79a3acdf-c409-4e2d-8e7f-5a3af205008e\") " Jun 14 15:59:00.729805 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.729779 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "79a3acdf-c409-4e2d-8e7f-5a3af205008e" (UID: "79a3acdf-c409-4e2d-8e7f-5a3af205008e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:59:00.729964 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.729937 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79a3acdf-c409-4e2d-8e7f-5a3af205008e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "79a3acdf-c409-4e2d-8e7f-5a3af205008e" (UID: "79a3acdf-c409-4e2d-8e7f-5a3af205008e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 15:59:00.732410 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.732379 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79a3acdf-c409-4e2d-8e7f-5a3af205008e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "79a3acdf-c409-4e2d-8e7f-5a3af205008e" (UID: "79a3acdf-c409-4e2d-8e7f-5a3af205008e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:59:00.732410 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.732383 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "79a3acdf-c409-4e2d-8e7f-5a3af205008e" (UID: "79a3acdf-c409-4e2d-8e7f-5a3af205008e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:59:00.732614 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.732510 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79a3acdf-c409-4e2d-8e7f-5a3af205008e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "79a3acdf-c409-4e2d-8e7f-5a3af205008e" (UID: "79a3acdf-c409-4e2d-8e7f-5a3af205008e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 15:59:00.732614 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.732513 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "79a3acdf-c409-4e2d-8e7f-5a3af205008e" (UID: "79a3acdf-c409-4e2d-8e7f-5a3af205008e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:59:00.732614 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.732511 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-kube-api-access-sgx66" (OuterVolumeSpecName: "kube-api-access-sgx66") pod "79a3acdf-c409-4e2d-8e7f-5a3af205008e" (UID: "79a3acdf-c409-4e2d-8e7f-5a3af205008e"). InnerVolumeSpecName "kube-api-access-sgx66". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 15:59:00.737936 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.737904 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79a3acdf-c409-4e2d-8e7f-5a3af205008e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "79a3acdf-c409-4e2d-8e7f-5a3af205008e" (UID: "79a3acdf-c409-4e2d-8e7f-5a3af205008e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 15:59:00.830544 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.830503 2528 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-certificates\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 14 15:59:00.830544 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.830533 2528 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79a3acdf-c409-4e2d-8e7f-5a3af205008e-ca-trust-extracted\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 14 15:59:00.830544 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.830543 2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgx66\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-kube-api-access-sgx66\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 14 15:59:00.830544 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.830553 2528 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79a3acdf-c409-4e2d-8e7f-5a3af205008e-installation-pull-secrets\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 14 15:59:00.830801 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.830562 2528 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-bound-sa-token\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 14 15:59:00.830801 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.830570 2528 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79a3acdf-c409-4e2d-8e7f-5a3af205008e-trusted-ca\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 14 15:59:00.830801 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.830579 2528 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79a3acdf-c409-4e2d-8e7f-5a3af205008e-image-registry-private-configuration\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 14 15:59:00.830801 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.830589 2528 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79a3acdf-c409-4e2d-8e7f-5a3af205008e-registry-tls\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 14 15:59:00.935339 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.935306 2528 generic.go:356] "Generic (PLEG): container finished" podID="79a3acdf-c409-4e2d-8e7f-5a3af205008e" containerID="69a6bca07a8a109c5fbd9a771e8587f8cbe9a99ae80796584b6cb25a991b0001" exitCode=0 Jun 14 15:59:00.935339 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.935353 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" Jun 14 15:59:00.935578 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.935395 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" event={"ID":"79a3acdf-c409-4e2d-8e7f-5a3af205008e","Type":"ContainerDied","Data":"69a6bca07a8a109c5fbd9a771e8587f8cbe9a99ae80796584b6cb25a991b0001"} Jun 14 15:59:00.935578 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.935452 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5467bb9bd-rtrsb" event={"ID":"79a3acdf-c409-4e2d-8e7f-5a3af205008e","Type":"ContainerDied","Data":"ad93d2d282ef99af1a9d9bbc2424fb56f2030eb0072fa662983a349a3fb1c012"} Jun 14 15:59:00.935578 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.935475 2528 scope.go:117] "RemoveContainer" containerID="69a6bca07a8a109c5fbd9a771e8587f8cbe9a99ae80796584b6cb25a991b0001" Jun 14 15:59:00.944900 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.944877 2528 scope.go:117] "RemoveContainer" containerID="69a6bca07a8a109c5fbd9a771e8587f8cbe9a99ae80796584b6cb25a991b0001" Jun 14 15:59:00.945232 ip-10-0-143-112 kubenswrapper[2528]: E0614 15:59:00.945191 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69a6bca07a8a109c5fbd9a771e8587f8cbe9a99ae80796584b6cb25a991b0001\": container with ID starting with 69a6bca07a8a109c5fbd9a771e8587f8cbe9a99ae80796584b6cb25a991b0001 not found: ID does not exist" containerID="69a6bca07a8a109c5fbd9a771e8587f8cbe9a99ae80796584b6cb25a991b0001" Jun 14 15:59:00.945298 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.945257 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69a6bca07a8a109c5fbd9a771e8587f8cbe9a99ae80796584b6cb25a991b0001"} err="failed to get container status \"69a6bca07a8a109c5fbd9a771e8587f8cbe9a99ae80796584b6cb25a991b0001\": rpc error: code = NotFound desc = could not find container \"69a6bca07a8a109c5fbd9a771e8587f8cbe9a99ae80796584b6cb25a991b0001\": container with ID starting with 69a6bca07a8a109c5fbd9a771e8587f8cbe9a99ae80796584b6cb25a991b0001 not found: ID does not exist" Jun 14 15:59:00.955748 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.955717 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5467bb9bd-rtrsb"] Jun 14 15:59:00.959292 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:00.959261 2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5467bb9bd-rtrsb"] Jun 14 15:59:01.571614 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:01.571581 2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79a3acdf-c409-4e2d-8e7f-5a3af205008e" path="/var/lib/kubelet/pods/79a3acdf-c409-4e2d-8e7f-5a3af205008e/volumes" Jun 14 15:59:02.306640 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:02.306590 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:59:02.327639 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:02.327613 2528 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 15:59:02.962543 ip-10-0-143-112 kubenswrapper[2528]: I0614 15:59:02.962509 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 14 16:00:37.745719 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:37.745624 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-vxf4d"] Jun 14 16:00:37.746259 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:37.746169 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79a3acdf-c409-4e2d-8e7f-5a3af205008e" containerName="registry" Jun 14 16:00:37.746259 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:37.746192 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="79a3acdf-c409-4e2d-8e7f-5a3af205008e" containerName="registry" Jun 14 16:00:37.746383 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:37.746294 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="79a3acdf-c409-4e2d-8e7f-5a3af205008e" containerName="registry" Jun 14 16:00:37.749410 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:37.749388 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-vxf4d" Jun 14 16:00:37.751573 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:37.751549 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 14 16:00:37.752162 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:37.752148 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 14 16:00:37.752269 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:37.752171 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-zc6l9\"" Jun 14 16:00:37.758628 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:37.758604 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-vxf4d"] Jun 14 16:00:37.927277 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:37.927233 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92675f8e-869d-4ba8-865e-9a527bf7e8f9-bound-sa-token\") pod \"cert-manager-59c77684cc-vxf4d\" (UID: \"92675f8e-869d-4ba8-865e-9a527bf7e8f9\") " pod="cert-manager/cert-manager-59c77684cc-vxf4d" Jun 14 16:00:37.927473 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:37.927305 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwhgc\" (UniqueName: \"kubernetes.io/projected/92675f8e-869d-4ba8-865e-9a527bf7e8f9-kube-api-access-xwhgc\") pod \"cert-manager-59c77684cc-vxf4d\" (UID: \"92675f8e-869d-4ba8-865e-9a527bf7e8f9\") " pod="cert-manager/cert-manager-59c77684cc-vxf4d" Jun 14 16:00:38.028181 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.028094 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92675f8e-869d-4ba8-865e-9a527bf7e8f9-bound-sa-token\") pod \"cert-manager-59c77684cc-vxf4d\" (UID: \"92675f8e-869d-4ba8-865e-9a527bf7e8f9\") " pod="cert-manager/cert-manager-59c77684cc-vxf4d" Jun 14 16:00:38.028181 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.028156 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwhgc\" (UniqueName: \"kubernetes.io/projected/92675f8e-869d-4ba8-865e-9a527bf7e8f9-kube-api-access-xwhgc\") pod \"cert-manager-59c77684cc-vxf4d\" (UID: \"92675f8e-869d-4ba8-865e-9a527bf7e8f9\") " pod="cert-manager/cert-manager-59c77684cc-vxf4d" Jun 14 16:00:38.035834 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.035795 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92675f8e-869d-4ba8-865e-9a527bf7e8f9-bound-sa-token\") pod \"cert-manager-59c77684cc-vxf4d\" (UID: \"92675f8e-869d-4ba8-865e-9a527bf7e8f9\") " pod="cert-manager/cert-manager-59c77684cc-vxf4d" Jun 14 16:00:38.035975 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.035864 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwhgc\" (UniqueName: \"kubernetes.io/projected/92675f8e-869d-4ba8-865e-9a527bf7e8f9-kube-api-access-xwhgc\") pod \"cert-manager-59c77684cc-vxf4d\" (UID: \"92675f8e-869d-4ba8-865e-9a527bf7e8f9\") " pod="cert-manager/cert-manager-59c77684cc-vxf4d" Jun 14 16:00:38.068553 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.068518 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-vxf4d" Jun 14 16:00:38.201395 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.201368 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-vxf4d"] Jun 14 16:00:38.203919 ip-10-0-143-112 kubenswrapper[2528]: W0614 16:00:38.203882 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92675f8e_869d_4ba8_865e_9a527bf7e8f9.slice/crio-ef942c1c016479965934ff107e4f945540576f980c266611119c17c72063f557 WatchSource:0}: Error finding container ef942c1c016479965934ff107e4f945540576f980c266611119c17c72063f557: Status 404 returned error can't find the container with id ef942c1c016479965934ff107e4f945540576f980c266611119c17c72063f557 Jun 14 16:00:38.205903 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.205883 2528 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 16:00:38.356276 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.356161 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-vxf4d" event={"ID":"92675f8e-869d-4ba8-865e-9a527bf7e8f9","Type":"ContainerStarted","Data":"ef942c1c016479965934ff107e4f945540576f980c266611119c17c72063f557"} Jun 14 16:00:38.389585 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.389542 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xc9sk"] Jun 14 16:00:38.394075 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.394046 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xc9sk" Jun 14 16:00:38.396172 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.396147 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 14 16:00:38.396324 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.396187 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 14 16:00:38.396324 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.396207 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-r66k4\"" Jun 14 16:00:38.399352 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.399326 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xc9sk"] Jun 14 16:00:38.533019 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.532979 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxh6x\" (UniqueName: \"kubernetes.io/projected/641b0995-49e2-47d6-b2a9-964a9ab0e872-kube-api-access-dxh6x\") pod \"openshift-lws-operator-fd8ccff4c-xc9sk\" (UID: \"641b0995-49e2-47d6-b2a9-964a9ab0e872\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xc9sk" Jun 14 16:00:38.533200 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.533039 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/641b0995-49e2-47d6-b2a9-964a9ab0e872-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xc9sk\" (UID: \"641b0995-49e2-47d6-b2a9-964a9ab0e872\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xc9sk" Jun 14 16:00:38.634281 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.634244 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxh6x\" (UniqueName: \"kubernetes.io/projected/641b0995-49e2-47d6-b2a9-964a9ab0e872-kube-api-access-dxh6x\") pod \"openshift-lws-operator-fd8ccff4c-xc9sk\" (UID: \"641b0995-49e2-47d6-b2a9-964a9ab0e872\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xc9sk" Jun 14 16:00:38.634529 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.634357 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/641b0995-49e2-47d6-b2a9-964a9ab0e872-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xc9sk\" (UID: \"641b0995-49e2-47d6-b2a9-964a9ab0e872\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xc9sk" Jun 14 16:00:38.634765 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.634745 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/641b0995-49e2-47d6-b2a9-964a9ab0e872-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xc9sk\" (UID: \"641b0995-49e2-47d6-b2a9-964a9ab0e872\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xc9sk" Jun 14 16:00:38.642695 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.642665 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxh6x\" (UniqueName: \"kubernetes.io/projected/641b0995-49e2-47d6-b2a9-964a9ab0e872-kube-api-access-dxh6x\") pod \"openshift-lws-operator-fd8ccff4c-xc9sk\" (UID: \"641b0995-49e2-47d6-b2a9-964a9ab0e872\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xc9sk" Jun 14 16:00:38.705564 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.705519 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xc9sk" Jun 14 16:00:38.894607 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:38.894513 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xc9sk"] Jun 14 16:00:38.898535 ip-10-0-143-112 kubenswrapper[2528]: W0614 16:00:38.898480 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod641b0995_49e2_47d6_b2a9_964a9ab0e872.slice/crio-84e51def2385fea09c7b1c698fd95880581258c09283cec2b28d5565b61238dc WatchSource:0}: Error finding container 84e51def2385fea09c7b1c698fd95880581258c09283cec2b28d5565b61238dc: Status 404 returned error can't find the container with id 84e51def2385fea09c7b1c698fd95880581258c09283cec2b28d5565b61238dc Jun 14 16:00:39.364806 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:39.364691 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xc9sk" event={"ID":"641b0995-49e2-47d6-b2a9-964a9ab0e872","Type":"ContainerStarted","Data":"84e51def2385fea09c7b1c698fd95880581258c09283cec2b28d5565b61238dc"} Jun 14 16:00:41.376804 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:41.376714 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-vxf4d" event={"ID":"92675f8e-869d-4ba8-865e-9a527bf7e8f9","Type":"ContainerStarted","Data":"9268f55603ba8d94d5288a3ed523f235309ba0aae8dbc0e8d29cbf1b065da7ad"} Jun 14 16:00:41.393036 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:41.392973 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-vxf4d" podStartSLOduration=1.5644701090000002 podStartE2EDuration="4.392954731s" totalImagesPullingTime="2.828484622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:00:41.391271123 +0000 UTC m=+442.320918821" watchObservedRunningTime="2026-06-14 16:00:41.392954731 +0000 UTC m=+442.322602425" Jun 14 16:00:43.388497 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:43.388463 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xc9sk" event={"ID":"641b0995-49e2-47d6-b2a9-964a9ab0e872","Type":"ContainerStarted","Data":"26fa43622a20f480e0a0dd284da5fa71fadf25af93594590360f9b97bc896470"} Jun 14 16:00:43.403714 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:43.403660 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xc9sk" podStartSLOduration=1.210374353 podStartE2EDuration="5.403642707s" totalImagesPullingTime="4.193268354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:00:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:00:43.40269023 +0000 UTC m=+444.332337926" watchObservedRunningTime="2026-06-14 16:00:43.403642707 +0000 UTC m=+444.333290402" Jun 14 16:00:58.931016 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:58.930974 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp"] Jun 14 16:00:58.937870 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:58.937841 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:00:58.943286 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:58.943254 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 16:00:58.943463 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:58.943341 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 16:00:58.943463 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:58.943387 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qm8qn\"" Jun 14 16:00:58.943741 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:58.943727 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 16:00:58.945231 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:58.945196 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 16:00:58.952750 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:58.952720 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp"] Jun 14 16:00:59.011851 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:59.011808 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa0f63df-8bb6-4536-a575-628a5d56085b-tmp\") pod \"opendatahub-operator-controller-manager-6669f54779-b2drp\" (UID: \"fa0f63df-8bb6-4536-a575-628a5d56085b\") " pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:00:59.012052 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:59.011893 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fa0f63df-8bb6-4536-a575-628a5d56085b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6669f54779-b2drp\" (UID: \"fa0f63df-8bb6-4536-a575-628a5d56085b\") " pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:00:59.012052 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:59.011928 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl2dh\" (UniqueName: \"kubernetes.io/projected/fa0f63df-8bb6-4536-a575-628a5d56085b-kube-api-access-kl2dh\") pod \"opendatahub-operator-controller-manager-6669f54779-b2drp\" (UID: \"fa0f63df-8bb6-4536-a575-628a5d56085b\") " pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:00:59.012052 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:59.011998 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa0f63df-8bb6-4536-a575-628a5d56085b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6669f54779-b2drp\" (UID: \"fa0f63df-8bb6-4536-a575-628a5d56085b\") " pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:00:59.012204 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:59.012067 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fa0f63df-8bb6-4536-a575-628a5d56085b-manifests\") pod \"opendatahub-operator-controller-manager-6669f54779-b2drp\" (UID: \"fa0f63df-8bb6-4536-a575-628a5d56085b\") " pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:00:59.113173 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:59.113129 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fa0f63df-8bb6-4536-a575-628a5d56085b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6669f54779-b2drp\" (UID: \"fa0f63df-8bb6-4536-a575-628a5d56085b\") " pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:00:59.113173 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:59.113178 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl2dh\" (UniqueName: \"kubernetes.io/projected/fa0f63df-8bb6-4536-a575-628a5d56085b-kube-api-access-kl2dh\") pod \"opendatahub-operator-controller-manager-6669f54779-b2drp\" (UID: \"fa0f63df-8bb6-4536-a575-628a5d56085b\") " pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:00:59.113463 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:59.113366 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa0f63df-8bb6-4536-a575-628a5d56085b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6669f54779-b2drp\" (UID: \"fa0f63df-8bb6-4536-a575-628a5d56085b\") " pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:00:59.113463 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:59.113444 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fa0f63df-8bb6-4536-a575-628a5d56085b-manifests\") pod \"opendatahub-operator-controller-manager-6669f54779-b2drp\" (UID: \"fa0f63df-8bb6-4536-a575-628a5d56085b\") " pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:00:59.113573 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:59.113498 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa0f63df-8bb6-4536-a575-628a5d56085b-tmp\") pod \"opendatahub-operator-controller-manager-6669f54779-b2drp\" (UID: \"fa0f63df-8bb6-4536-a575-628a5d56085b\") " pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:00:59.113848 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:59.113821 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fa0f63df-8bb6-4536-a575-628a5d56085b-manifests\") pod \"opendatahub-operator-controller-manager-6669f54779-b2drp\" (UID: \"fa0f63df-8bb6-4536-a575-628a5d56085b\") " pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:00:59.115757 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:59.115727 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa0f63df-8bb6-4536-a575-628a5d56085b-tmp\") pod \"opendatahub-operator-controller-manager-6669f54779-b2drp\" (UID: \"fa0f63df-8bb6-4536-a575-628a5d56085b\") " pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:00:59.115849 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:59.115836 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fa0f63df-8bb6-4536-a575-628a5d56085b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6669f54779-b2drp\" (UID: \"fa0f63df-8bb6-4536-a575-628a5d56085b\") " pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:00:59.115940 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:59.115923 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa0f63df-8bb6-4536-a575-628a5d56085b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6669f54779-b2drp\" (UID: \"fa0f63df-8bb6-4536-a575-628a5d56085b\") " pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:00:59.121182 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:59.121155 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl2dh\" (UniqueName: \"kubernetes.io/projected/fa0f63df-8bb6-4536-a575-628a5d56085b-kube-api-access-kl2dh\") pod \"opendatahub-operator-controller-manager-6669f54779-b2drp\" (UID: \"fa0f63df-8bb6-4536-a575-628a5d56085b\") " pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:00:59.248774 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:59.248677 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:00:59.401747 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:59.401720 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp"] Jun 14 16:00:59.404799 ip-10-0-143-112 kubenswrapper[2528]: W0614 16:00:59.404752 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa0f63df_8bb6_4536_a575_628a5d56085b.slice/crio-8952cbffa51b63a81f1e2b926afe1b650433930bf9bd83a64e3d7ee663d5b48f WatchSource:0}: Error finding container 8952cbffa51b63a81f1e2b926afe1b650433930bf9bd83a64e3d7ee663d5b48f: Status 404 returned error can't find the container with id 8952cbffa51b63a81f1e2b926afe1b650433930bf9bd83a64e3d7ee663d5b48f Jun 14 16:00:59.463281 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:00:59.463250 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" event={"ID":"fa0f63df-8bb6-4536-a575-628a5d56085b","Type":"ContainerStarted","Data":"8952cbffa51b63a81f1e2b926afe1b650433930bf9bd83a64e3d7ee663d5b48f"} Jun 14 16:01:02.481488 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:02.481448 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" event={"ID":"fa0f63df-8bb6-4536-a575-628a5d56085b","Type":"ContainerStarted","Data":"c620342d6928a945c57e2d0df336a5a3763e87cd0ac3539c6f4fa15a2f3c32ab"} Jun 14 16:01:03.487908 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:03.487872 2528 generic.go:356] "Generic (PLEG): container finished" podID="fa0f63df-8bb6-4536-a575-628a5d56085b" containerID="c620342d6928a945c57e2d0df336a5a3763e87cd0ac3539c6f4fa15a2f3c32ab" exitCode=0 Jun 14 16:01:03.488304 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:03.487954 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" event={"ID":"fa0f63df-8bb6-4536-a575-628a5d56085b","Type":"ContainerDied","Data":"c620342d6928a945c57e2d0df336a5a3763e87cd0ac3539c6f4fa15a2f3c32ab"} Jun 14 16:01:04.495491 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:04.495453 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" event={"ID":"fa0f63df-8bb6-4536-a575-628a5d56085b","Type":"ContainerStarted","Data":"0ea6bf83aa0f080c1f7a1ebb626797f680be635e90483c9bc51693035ae1b0a8"} Jun 14 16:01:04.495992 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:04.495561 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:01:04.516316 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:04.516260 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" podStartSLOduration=2.2213731389999998 podStartE2EDuration="6.516241694s" totalImagesPullingTime="3.222674313s" totalInitContainerRuntime="1.072194242s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:00:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:01:04.515134076 +0000 UTC m=+465.444781819" watchObservedRunningTime="2026-06-14 16:01:04.516241694 +0000 UTC m=+465.445889380" Jun 14 16:01:15.503296 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:15.503262 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6669f54779-b2drp" Jun 14 16:01:17.795071 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:17.795038 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-4v4wf"] Jun 14 16:01:17.802358 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:17.802334 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-4v4wf" Jun 14 16:01:17.804931 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:17.804884 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-k75n6\"" Jun 14 16:01:17.805118 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:17.805090 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 14 16:01:17.806624 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:17.806602 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-4v4wf"] Jun 14 16:01:17.896099 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:17.896053 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f01adee1-5764-4ed5-b545-0c2d9a7e18d7-cert\") pod \"odh-model-controller-6dc94f689f-4v4wf\" (UID: \"f01adee1-5764-4ed5-b545-0c2d9a7e18d7\") " pod="opendatahub/odh-model-controller-6dc94f689f-4v4wf" Jun 14 16:01:17.896274 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:17.896111 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx7k7\" (UniqueName: \"kubernetes.io/projected/f01adee1-5764-4ed5-b545-0c2d9a7e18d7-kube-api-access-fx7k7\") pod \"odh-model-controller-6dc94f689f-4v4wf\" (UID: \"f01adee1-5764-4ed5-b545-0c2d9a7e18d7\") " pod="opendatahub/odh-model-controller-6dc94f689f-4v4wf" Jun 14 16:01:17.997261 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:17.997231 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f01adee1-5764-4ed5-b545-0c2d9a7e18d7-cert\") pod \"odh-model-controller-6dc94f689f-4v4wf\" (UID: \"f01adee1-5764-4ed5-b545-0c2d9a7e18d7\") " pod="opendatahub/odh-model-controller-6dc94f689f-4v4wf" Jun 14 16:01:17.997261 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:17.997273 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx7k7\" (UniqueName: \"kubernetes.io/projected/f01adee1-5764-4ed5-b545-0c2d9a7e18d7-kube-api-access-fx7k7\") pod \"odh-model-controller-6dc94f689f-4v4wf\" (UID: \"f01adee1-5764-4ed5-b545-0c2d9a7e18d7\") " pod="opendatahub/odh-model-controller-6dc94f689f-4v4wf" Jun 14 16:01:17.997471 ip-10-0-143-112 kubenswrapper[2528]: E0614 16:01:17.997402 2528 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 14 16:01:17.997510 ip-10-0-143-112 kubenswrapper[2528]: E0614 16:01:17.997478 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f01adee1-5764-4ed5-b545-0c2d9a7e18d7-cert podName:f01adee1-5764-4ed5-b545-0c2d9a7e18d7 nodeName:}" failed. No retries permitted until 2026-06-14 16:01:18.497458394 +0000 UTC m=+479.427106072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f01adee1-5764-4ed5-b545-0c2d9a7e18d7-cert") pod "odh-model-controller-6dc94f689f-4v4wf" (UID: "f01adee1-5764-4ed5-b545-0c2d9a7e18d7") : secret "odh-model-controller-webhook-cert" not found Jun 14 16:01:18.009075 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:18.009046 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx7k7\" (UniqueName: \"kubernetes.io/projected/f01adee1-5764-4ed5-b545-0c2d9a7e18d7-kube-api-access-fx7k7\") pod \"odh-model-controller-6dc94f689f-4v4wf\" (UID: \"f01adee1-5764-4ed5-b545-0c2d9a7e18d7\") " pod="opendatahub/odh-model-controller-6dc94f689f-4v4wf" Jun 14 16:01:18.503122 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:18.503082 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f01adee1-5764-4ed5-b545-0c2d9a7e18d7-cert\") pod \"odh-model-controller-6dc94f689f-4v4wf\" (UID: \"f01adee1-5764-4ed5-b545-0c2d9a7e18d7\") " pod="opendatahub/odh-model-controller-6dc94f689f-4v4wf" Jun 14 16:01:18.505780 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:18.505759 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f01adee1-5764-4ed5-b545-0c2d9a7e18d7-cert\") pod \"odh-model-controller-6dc94f689f-4v4wf\" (UID: \"f01adee1-5764-4ed5-b545-0c2d9a7e18d7\") " pod="opendatahub/odh-model-controller-6dc94f689f-4v4wf" Jun 14 16:01:18.587853 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:18.587818 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-85cpb"] Jun 14 16:01:18.591970 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:18.591944 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-85cpb" Jun 14 16:01:18.593969 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:18.593938 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 14 16:01:18.594111 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:18.593984 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-zk8fr\"" Jun 14 16:01:18.602096 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:18.602068 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-85cpb"] Jun 14 16:01:18.705525 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:18.705487 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/581cd7bb-0c45-4d34-afff-2d7f81bd1db1-tls-certs\") pod \"model-serving-api-5dd488fc48-85cpb\" (UID: \"581cd7bb-0c45-4d34-afff-2d7f81bd1db1\") " pod="opendatahub/model-serving-api-5dd488fc48-85cpb" Jun 14 16:01:18.705713 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:18.705670 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qq66\" (UniqueName: \"kubernetes.io/projected/581cd7bb-0c45-4d34-afff-2d7f81bd1db1-kube-api-access-6qq66\") pod \"model-serving-api-5dd488fc48-85cpb\" (UID: \"581cd7bb-0c45-4d34-afff-2d7f81bd1db1\") " pod="opendatahub/model-serving-api-5dd488fc48-85cpb" Jun 14 16:01:18.714360 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:18.714326 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-4v4wf" Jun 14 16:01:18.807470 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:18.807435 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/581cd7bb-0c45-4d34-afff-2d7f81bd1db1-tls-certs\") pod \"model-serving-api-5dd488fc48-85cpb\" (UID: \"581cd7bb-0c45-4d34-afff-2d7f81bd1db1\") " pod="opendatahub/model-serving-api-5dd488fc48-85cpb" Jun 14 16:01:18.807955 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:18.807487 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qq66\" (UniqueName: \"kubernetes.io/projected/581cd7bb-0c45-4d34-afff-2d7f81bd1db1-kube-api-access-6qq66\") pod \"model-serving-api-5dd488fc48-85cpb\" (UID: \"581cd7bb-0c45-4d34-afff-2d7f81bd1db1\") " pod="opendatahub/model-serving-api-5dd488fc48-85cpb" Jun 14 16:01:18.810431 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:18.810408 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/581cd7bb-0c45-4d34-afff-2d7f81bd1db1-tls-certs\") pod \"model-serving-api-5dd488fc48-85cpb\" (UID: \"581cd7bb-0c45-4d34-afff-2d7f81bd1db1\") " pod="opendatahub/model-serving-api-5dd488fc48-85cpb" Jun 14 16:01:18.816815 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:18.816771 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qq66\" (UniqueName: \"kubernetes.io/projected/581cd7bb-0c45-4d34-afff-2d7f81bd1db1-kube-api-access-6qq66\") pod \"model-serving-api-5dd488fc48-85cpb\" (UID: \"581cd7bb-0c45-4d34-afff-2d7f81bd1db1\") " pod="opendatahub/model-serving-api-5dd488fc48-85cpb" Jun 14 16:01:18.867602 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:18.867572 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-4v4wf"] Jun 14 16:01:18.870267 ip-10-0-143-112 kubenswrapper[2528]: W0614 16:01:18.870235 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf01adee1_5764_4ed5_b545_0c2d9a7e18d7.slice/crio-256ee548685ff568e72fc3c9ec921d69826a4401a8ef133ba95f14c1d5c0ce5a WatchSource:0}: Error finding container 256ee548685ff568e72fc3c9ec921d69826a4401a8ef133ba95f14c1d5c0ce5a: Status 404 returned error can't find the container with id 256ee548685ff568e72fc3c9ec921d69826a4401a8ef133ba95f14c1d5c0ce5a Jun 14 16:01:18.906329 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:18.906286 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-85cpb" Jun 14 16:01:19.059680 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:19.059649 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-85cpb"] Jun 14 16:01:19.061406 ip-10-0-143-112 kubenswrapper[2528]: W0614 16:01:19.061371 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod581cd7bb_0c45_4d34_afff_2d7f81bd1db1.slice/crio-e36143d480b7ef7068e5a836ea9392a3372246199c6e3718cec490e202d782b4 WatchSource:0}: Error finding container e36143d480b7ef7068e5a836ea9392a3372246199c6e3718cec490e202d782b4: Status 404 returned error can't find the container with id e36143d480b7ef7068e5a836ea9392a3372246199c6e3718cec490e202d782b4 Jun 14 16:01:19.586009 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:19.585948 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-4v4wf" event={"ID":"f01adee1-5764-4ed5-b545-0c2d9a7e18d7","Type":"ContainerStarted","Data":"256ee548685ff568e72fc3c9ec921d69826a4401a8ef133ba95f14c1d5c0ce5a"} Jun 14 16:01:19.586204 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:19.586037 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-85cpb" event={"ID":"581cd7bb-0c45-4d34-afff-2d7f81bd1db1","Type":"ContainerStarted","Data":"e36143d480b7ef7068e5a836ea9392a3372246199c6e3718cec490e202d782b4"} Jun 14 16:01:23.607549 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:23.607500 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-85cpb" event={"ID":"581cd7bb-0c45-4d34-afff-2d7f81bd1db1","Type":"ContainerStarted","Data":"deb568ccfd92c6a24a72656f92a2744e16640aa72432a74ad9fe5b4c39ef176b"} Jun 14 16:01:23.608023 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:23.607578 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-85cpb" Jun 14 16:01:23.609140 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:23.609115 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-4v4wf" event={"ID":"f01adee1-5764-4ed5-b545-0c2d9a7e18d7","Type":"ContainerStarted","Data":"d54c6c6a312ac02dd960d7953beac246db19c5b70306b3a6d3eb7ca8e81025a9"} Jun 14 16:01:23.609300 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:23.609262 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-4v4wf" Jun 14 16:01:23.626345 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:23.626285 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-85cpb" podStartSLOduration=1.631659301 podStartE2EDuration="5.626262436s" totalImagesPullingTime="3.994603135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:01:23.625046698 +0000 UTC m=+484.554694393" watchObservedRunningTime="2026-06-14 16:01:23.626262436 +0000 UTC m=+484.555910132" Jun 14 16:01:23.643148 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:23.643056 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-4v4wf" podStartSLOduration=2.412193217 podStartE2EDuration="6.643031095s" totalImagesPullingTime="4.230837878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:01:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:01:23.640347755 +0000 UTC m=+484.569995452" watchObservedRunningTime="2026-06-14 16:01:23.643031095 +0000 UTC m=+484.572678791" Jun 14 16:01:27.864735 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:27.864701 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-z726v"] Jun 14 16:01:27.868554 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:27.868529 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-z726v" Jun 14 16:01:27.871299 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:27.871276 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 14 16:01:27.871416 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:27.871335 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-6gqvk\"" Jun 14 16:01:27.880763 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:27.880404 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-z726v"] Jun 14 16:01:27.882733 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:27.882709 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-7fbzc"] Jun 14 16:01:27.886232 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:27.886191 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7fbzc" Jun 14 16:01:27.890679 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:27.890655 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-m59mw\"" Jun 14 16:01:27.890795 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:27.890716 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 14 16:01:27.898886 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:27.898858 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-7fbzc"] Jun 14 16:01:27.901967 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:27.901941 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8wnj\" (UniqueName: \"kubernetes.io/projected/9b34a062-4bc4-414e-81d2-dfef087c886f-kube-api-access-c8wnj\") pod \"llmisvc-controller-manager-864bfd7bc9-7fbzc\" (UID: \"9b34a062-4bc4-414e-81d2-dfef087c886f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7fbzc" Jun 14 16:01:27.902062 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:27.901985 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b34a062-4bc4-414e-81d2-dfef087c886f-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7fbzc\" (UID: \"9b34a062-4bc4-414e-81d2-dfef087c886f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7fbzc" Jun 14 16:01:28.003045 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.003001 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xl9v\" (UniqueName: \"kubernetes.io/projected/900b1f9f-db30-4d6a-ad0a-d73d70fa09b9-kube-api-access-4xl9v\") pod \"kserve-controller-manager-69fc866d76-z726v\" (UID: \"900b1f9f-db30-4d6a-ad0a-d73d70fa09b9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z726v" Jun 14 16:01:28.003248 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.003121 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8wnj\" (UniqueName: \"kubernetes.io/projected/9b34a062-4bc4-414e-81d2-dfef087c886f-kube-api-access-c8wnj\") pod \"llmisvc-controller-manager-864bfd7bc9-7fbzc\" (UID: \"9b34a062-4bc4-414e-81d2-dfef087c886f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7fbzc" Jun 14 16:01:28.003248 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.003163 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b34a062-4bc4-414e-81d2-dfef087c886f-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7fbzc\" (UID: \"9b34a062-4bc4-414e-81d2-dfef087c886f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7fbzc" Jun 14 16:01:28.003248 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.003180 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/900b1f9f-db30-4d6a-ad0a-d73d70fa09b9-cert\") pod \"kserve-controller-manager-69fc866d76-z726v\" (UID: \"900b1f9f-db30-4d6a-ad0a-d73d70fa09b9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z726v" Jun 14 16:01:28.003413 ip-10-0-143-112 kubenswrapper[2528]: E0614 16:01:28.003354 2528 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 14 16:01:28.003466 ip-10-0-143-112 kubenswrapper[2528]: E0614 16:01:28.003430 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b34a062-4bc4-414e-81d2-dfef087c886f-cert podName:9b34a062-4bc4-414e-81d2-dfef087c886f nodeName:}" failed. No retries permitted until 2026-06-14 16:01:28.503409304 +0000 UTC m=+489.433056991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b34a062-4bc4-414e-81d2-dfef087c886f-cert") pod "llmisvc-controller-manager-864bfd7bc9-7fbzc" (UID: "9b34a062-4bc4-414e-81d2-dfef087c886f") : secret "llmisvc-webhook-server-cert" not found Jun 14 16:01:28.029151 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.029116 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8wnj\" (UniqueName: \"kubernetes.io/projected/9b34a062-4bc4-414e-81d2-dfef087c886f-kube-api-access-c8wnj\") pod \"llmisvc-controller-manager-864bfd7bc9-7fbzc\" (UID: \"9b34a062-4bc4-414e-81d2-dfef087c886f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7fbzc" Jun 14 16:01:28.103711 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.103679 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/900b1f9f-db30-4d6a-ad0a-d73d70fa09b9-cert\") pod \"kserve-controller-manager-69fc866d76-z726v\" (UID: \"900b1f9f-db30-4d6a-ad0a-d73d70fa09b9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z726v" Jun 14 16:01:28.103876 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.103769 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xl9v\" (UniqueName: \"kubernetes.io/projected/900b1f9f-db30-4d6a-ad0a-d73d70fa09b9-kube-api-access-4xl9v\") pod \"kserve-controller-manager-69fc866d76-z726v\" (UID: \"900b1f9f-db30-4d6a-ad0a-d73d70fa09b9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z726v" Jun 14 16:01:28.106286 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.106264 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/900b1f9f-db30-4d6a-ad0a-d73d70fa09b9-cert\") pod \"kserve-controller-manager-69fc866d76-z726v\" (UID: \"900b1f9f-db30-4d6a-ad0a-d73d70fa09b9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z726v" Jun 14 16:01:28.117549 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.117479 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xl9v\" (UniqueName: \"kubernetes.io/projected/900b1f9f-db30-4d6a-ad0a-d73d70fa09b9-kube-api-access-4xl9v\") pod \"kserve-controller-manager-69fc866d76-z726v\" (UID: \"900b1f9f-db30-4d6a-ad0a-d73d70fa09b9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z726v" Jun 14 16:01:28.180687 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.180657 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-z726v" Jun 14 16:01:28.306010 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.305841 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-d56d8dc9f-f5nzd"] Jun 14 16:01:28.311115 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.311090 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d56d8dc9f-f5nzd" Jun 14 16:01:28.313484 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.313454 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 14 16:01:28.313738 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.313718 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ww2t9\"" Jun 14 16:01:28.313799 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.313774 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 14 16:01:28.313895 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.313720 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 16:01:28.313998 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.313980 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 16:01:28.321579 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.321439 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d56d8dc9f-f5nzd"] Jun 14 16:01:28.346535 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.346362 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-z726v"] Jun 14 16:01:28.349679 ip-10-0-143-112 kubenswrapper[2528]: W0614 16:01:28.349645 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod900b1f9f_db30_4d6a_ad0a_d73d70fa09b9.slice/crio-b1dbcf47455b60bec241c7da3e50157a70f0d9ea341b7ad3f4588088b4a0b6d1 WatchSource:0}: Error finding container b1dbcf47455b60bec241c7da3e50157a70f0d9ea341b7ad3f4588088b4a0b6d1: Status 404 returned error can't find the container with id b1dbcf47455b60bec241c7da3e50157a70f0d9ea341b7ad3f4588088b4a0b6d1 Jun 14 16:01:28.407932 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.407883 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwlp2\" (UniqueName: \"kubernetes.io/projected/59970e23-03fa-4641-afd5-560a91675fcb-kube-api-access-pwlp2\") pod \"kube-auth-proxy-d56d8dc9f-f5nzd\" (UID: \"59970e23-03fa-4641-afd5-560a91675fcb\") " pod="openshift-ingress/kube-auth-proxy-d56d8dc9f-f5nzd" Jun 14 16:01:28.408151 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.407961 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59970e23-03fa-4641-afd5-560a91675fcb-tls-certs\") pod \"kube-auth-proxy-d56d8dc9f-f5nzd\" (UID: \"59970e23-03fa-4641-afd5-560a91675fcb\") " pod="openshift-ingress/kube-auth-proxy-d56d8dc9f-f5nzd" Jun 14 16:01:28.408151 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.408029 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59970e23-03fa-4641-afd5-560a91675fcb-tmp\") pod \"kube-auth-proxy-d56d8dc9f-f5nzd\" (UID: \"59970e23-03fa-4641-afd5-560a91675fcb\") " pod="openshift-ingress/kube-auth-proxy-d56d8dc9f-f5nzd" Jun 14 16:01:28.509443 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.509403 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59970e23-03fa-4641-afd5-560a91675fcb-tmp\") pod \"kube-auth-proxy-d56d8dc9f-f5nzd\" (UID: \"59970e23-03fa-4641-afd5-560a91675fcb\") " pod="openshift-ingress/kube-auth-proxy-d56d8dc9f-f5nzd" Jun 14 16:01:28.509443 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.509452 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b34a062-4bc4-414e-81d2-dfef087c886f-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7fbzc\" (UID: \"9b34a062-4bc4-414e-81d2-dfef087c886f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7fbzc" Jun 14 16:01:28.509701 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.509510 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwlp2\" (UniqueName: \"kubernetes.io/projected/59970e23-03fa-4641-afd5-560a91675fcb-kube-api-access-pwlp2\") pod \"kube-auth-proxy-d56d8dc9f-f5nzd\" (UID: \"59970e23-03fa-4641-afd5-560a91675fcb\") " pod="openshift-ingress/kube-auth-proxy-d56d8dc9f-f5nzd" Jun 14 16:01:28.509701 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.509546 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59970e23-03fa-4641-afd5-560a91675fcb-tls-certs\") pod \"kube-auth-proxy-d56d8dc9f-f5nzd\" (UID: \"59970e23-03fa-4641-afd5-560a91675fcb\") " pod="openshift-ingress/kube-auth-proxy-d56d8dc9f-f5nzd" Jun 14 16:01:28.509701 ip-10-0-143-112 kubenswrapper[2528]: E0614 16:01:28.509643 2528 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 14 16:01:28.509701 ip-10-0-143-112 kubenswrapper[2528]: E0614 16:01:28.509700 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59970e23-03fa-4641-afd5-560a91675fcb-tls-certs podName:59970e23-03fa-4641-afd5-560a91675fcb nodeName:}" failed. No retries permitted until 2026-06-14 16:01:29.009683372 +0000 UTC m=+489.939331064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/59970e23-03fa-4641-afd5-560a91675fcb-tls-certs") pod "kube-auth-proxy-d56d8dc9f-f5nzd" (UID: "59970e23-03fa-4641-afd5-560a91675fcb") : secret "kube-auth-proxy-tls" not found Jun 14 16:01:28.511845 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.511815 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59970e23-03fa-4641-afd5-560a91675fcb-tmp\") pod \"kube-auth-proxy-d56d8dc9f-f5nzd\" (UID: \"59970e23-03fa-4641-afd5-560a91675fcb\") " pod="openshift-ingress/kube-auth-proxy-d56d8dc9f-f5nzd" Jun 14 16:01:28.512120 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.512098 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b34a062-4bc4-414e-81d2-dfef087c886f-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7fbzc\" (UID: \"9b34a062-4bc4-414e-81d2-dfef087c886f\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7fbzc" Jun 14 16:01:28.520025 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.519995 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwlp2\" (UniqueName: \"kubernetes.io/projected/59970e23-03fa-4641-afd5-560a91675fcb-kube-api-access-pwlp2\") pod \"kube-auth-proxy-d56d8dc9f-f5nzd\" (UID: \"59970e23-03fa-4641-afd5-560a91675fcb\") " pod="openshift-ingress/kube-auth-proxy-d56d8dc9f-f5nzd" Jun 14 16:01:28.635790 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.635752 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-z726v" event={"ID":"900b1f9f-db30-4d6a-ad0a-d73d70fa09b9","Type":"ContainerStarted","Data":"b1dbcf47455b60bec241c7da3e50157a70f0d9ea341b7ad3f4588088b4a0b6d1"} Jun 14 16:01:28.798423 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.798326 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7fbzc" Jun 14 16:01:28.952977 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:28.952936 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-7fbzc"] Jun 14 16:01:28.955486 ip-10-0-143-112 kubenswrapper[2528]: W0614 16:01:28.955444 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9b34a062_4bc4_414e_81d2_dfef087c886f.slice/crio-2b26df6762f693db784b5326b0e6f4995cab6e59ef1be9ab0771cb30306249e9 WatchSource:0}: Error finding container 2b26df6762f693db784b5326b0e6f4995cab6e59ef1be9ab0771cb30306249e9: Status 404 returned error can't find the container with id 2b26df6762f693db784b5326b0e6f4995cab6e59ef1be9ab0771cb30306249e9 Jun 14 16:01:29.014890 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:29.014853 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59970e23-03fa-4641-afd5-560a91675fcb-tls-certs\") pod \"kube-auth-proxy-d56d8dc9f-f5nzd\" (UID: \"59970e23-03fa-4641-afd5-560a91675fcb\") " pod="openshift-ingress/kube-auth-proxy-d56d8dc9f-f5nzd" Jun 14 16:01:29.017563 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:29.017530 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59970e23-03fa-4641-afd5-560a91675fcb-tls-certs\") pod \"kube-auth-proxy-d56d8dc9f-f5nzd\" (UID: \"59970e23-03fa-4641-afd5-560a91675fcb\") " pod="openshift-ingress/kube-auth-proxy-d56d8dc9f-f5nzd" Jun 14 16:01:29.225858 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:29.225812 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d56d8dc9f-f5nzd" Jun 14 16:01:29.377316 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:29.377270 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d56d8dc9f-f5nzd"] Jun 14 16:01:29.380048 ip-10-0-143-112 kubenswrapper[2528]: W0614 16:01:29.380003 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59970e23_03fa_4641_afd5_560a91675fcb.slice/crio-565c23c9505dcec8052d6c0b4a3bae3676507deaf7afac33cb1a9ecf39bd59b9 WatchSource:0}: Error finding container 565c23c9505dcec8052d6c0b4a3bae3676507deaf7afac33cb1a9ecf39bd59b9: Status 404 returned error can't find the container with id 565c23c9505dcec8052d6c0b4a3bae3676507deaf7afac33cb1a9ecf39bd59b9 Jun 14 16:01:29.643966 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:29.643925 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7fbzc" event={"ID":"9b34a062-4bc4-414e-81d2-dfef087c886f","Type":"ContainerStarted","Data":"2b26df6762f693db784b5326b0e6f4995cab6e59ef1be9ab0771cb30306249e9"} Jun 14 16:01:29.645563 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:29.645526 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d56d8dc9f-f5nzd" event={"ID":"59970e23-03fa-4641-afd5-560a91675fcb","Type":"ContainerStarted","Data":"565c23c9505dcec8052d6c0b4a3bae3676507deaf7afac33cb1a9ecf39bd59b9"} Jun 14 16:01:33.672356 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:33.672311 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-z726v" event={"ID":"900b1f9f-db30-4d6a-ad0a-d73d70fa09b9","Type":"ContainerStarted","Data":"49580e1658e02eaf502ac9c688bfc945774c0538c58566554cc787b37c301ccd"} Jun 14 16:01:33.672860 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:33.672390 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-z726v" Jun 14 16:01:33.674007 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:33.673978 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d56d8dc9f-f5nzd" event={"ID":"59970e23-03fa-4641-afd5-560a91675fcb","Type":"ContainerStarted","Data":"ab179f03a6f41ecdbf1000c0f1c4d97cdf664dabbb9edcb81d37ba2eb2c6f2ed"} Jun 14 16:01:33.675406 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:33.675379 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7fbzc" event={"ID":"9b34a062-4bc4-414e-81d2-dfef087c886f","Type":"ContainerStarted","Data":"02e83fa86ed48913933abec60107810bc17a82ebd732d66753853ad9ff1d46e3"} Jun 14 16:01:33.675543 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:33.675530 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7fbzc" Jun 14 16:01:33.688366 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:33.688317 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-z726v" podStartSLOduration=2.071409002 podStartE2EDuration="6.688299004s" totalImagesPullingTime="4.616890002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:01:33.687346743 +0000 UTC m=+494.616994462" watchObservedRunningTime="2026-06-14 16:01:33.688299004 +0000 UTC m=+494.617946720" Jun 14 16:01:33.704659 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:33.704605 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-d56d8dc9f-f5nzd" podStartSLOduration=2.11863867 podStartE2EDuration="5.704590981s" totalImagesPullingTime="3.585952311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:01:33.70308372 +0000 UTC m=+494.632731436" watchObservedRunningTime="2026-06-14 16:01:33.704590981 +0000 UTC m=+494.634238675" Jun 14 16:01:33.717254 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:33.717168 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7fbzc" podStartSLOduration=2.700006574 podStartE2EDuration="6.717146467s" totalImagesPullingTime="4.017139893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:01:33.716690775 +0000 UTC m=+494.646338472" watchObservedRunningTime="2026-06-14 16:01:33.717146467 +0000 UTC m=+494.646794162" Jun 14 16:01:34.617446 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:34.617416 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-4v4wf" Jun 14 16:01:34.619266 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:34.619247 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-85cpb" Jun 14 16:01:44.785062 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:44.785020 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6cc8f74cbf-tr6dh"] Jun 14 16:01:44.789315 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:44.789252 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6cc8f74cbf-tr6dh" Jun 14 16:01:44.791452 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:44.791429 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 14 16:01:44.791452 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:44.791443 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4qf4b\"" Jun 14 16:01:44.800654 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:44.800629 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6cc8f74cbf-tr6dh"] Jun 14 16:01:44.871287 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:44.871206 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/efb9efd2-6d01-4c5a-86b1-e14cd88eb234-redirect-config\") pod \"dashboard-redirect-6cc8f74cbf-tr6dh\" (UID: \"efb9efd2-6d01-4c5a-86b1-e14cd88eb234\") " pod="opendatahub/dashboard-redirect-6cc8f74cbf-tr6dh" Jun 14 16:01:44.871478 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:44.871414 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh9vx\" (UniqueName: \"kubernetes.io/projected/efb9efd2-6d01-4c5a-86b1-e14cd88eb234-kube-api-access-gh9vx\") pod \"dashboard-redirect-6cc8f74cbf-tr6dh\" (UID: \"efb9efd2-6d01-4c5a-86b1-e14cd88eb234\") " pod="opendatahub/dashboard-redirect-6cc8f74cbf-tr6dh" Jun 14 16:01:44.972926 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:44.972884 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh9vx\" (UniqueName: \"kubernetes.io/projected/efb9efd2-6d01-4c5a-86b1-e14cd88eb234-kube-api-access-gh9vx\") pod \"dashboard-redirect-6cc8f74cbf-tr6dh\" (UID: \"efb9efd2-6d01-4c5a-86b1-e14cd88eb234\") " pod="opendatahub/dashboard-redirect-6cc8f74cbf-tr6dh" Jun 14 16:01:44.973113 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:44.972959 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/efb9efd2-6d01-4c5a-86b1-e14cd88eb234-redirect-config\") pod \"dashboard-redirect-6cc8f74cbf-tr6dh\" (UID: \"efb9efd2-6d01-4c5a-86b1-e14cd88eb234\") " pod="opendatahub/dashboard-redirect-6cc8f74cbf-tr6dh" Jun 14 16:01:44.973712 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:44.973692 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/efb9efd2-6d01-4c5a-86b1-e14cd88eb234-redirect-config\") pod \"dashboard-redirect-6cc8f74cbf-tr6dh\" (UID: \"efb9efd2-6d01-4c5a-86b1-e14cd88eb234\") " pod="opendatahub/dashboard-redirect-6cc8f74cbf-tr6dh" Jun 14 16:01:44.985502 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:44.985466 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh9vx\" (UniqueName: \"kubernetes.io/projected/efb9efd2-6d01-4c5a-86b1-e14cd88eb234-kube-api-access-gh9vx\") pod \"dashboard-redirect-6cc8f74cbf-tr6dh\" (UID: \"efb9efd2-6d01-4c5a-86b1-e14cd88eb234\") " pod="opendatahub/dashboard-redirect-6cc8f74cbf-tr6dh" Jun 14 16:01:45.101515 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:45.101433 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6cc8f74cbf-tr6dh" Jun 14 16:01:45.265159 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:45.265119 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6cc8f74cbf-tr6dh"] Jun 14 16:01:45.267782 ip-10-0-143-112 kubenswrapper[2528]: W0614 16:01:45.267746 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefb9efd2_6d01_4c5a_86b1_e14cd88eb234.slice/crio-3a09dfd2d1e888a1c29819b4f9c5588afb348b37a91aac338792e8e3dab04456 WatchSource:0}: Error finding container 3a09dfd2d1e888a1c29819b4f9c5588afb348b37a91aac338792e8e3dab04456: Status 404 returned error can't find the container with id 3a09dfd2d1e888a1c29819b4f9c5588afb348b37a91aac338792e8e3dab04456 Jun 14 16:01:45.738347 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:45.738309 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6cc8f74cbf-tr6dh" event={"ID":"efb9efd2-6d01-4c5a-86b1-e14cd88eb234","Type":"ContainerStarted","Data":"3a09dfd2d1e888a1c29819b4f9c5588afb348b37a91aac338792e8e3dab04456"} Jun 14 16:01:48.759290 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:48.759253 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6cc8f74cbf-tr6dh" event={"ID":"efb9efd2-6d01-4c5a-86b1-e14cd88eb234","Type":"ContainerStarted","Data":"757c27f3adfae9188eb853be9f16070ecc7c210860eb970b79a222eca7362e41"} Jun 14 16:01:48.777793 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:48.777733 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6cc8f74cbf-tr6dh" podStartSLOduration=2.06425402 podStartE2EDuration="4.77771366s" totalImagesPullingTime="2.71345964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:01:48.776855808 +0000 UTC m=+509.706503503" watchObservedRunningTime="2026-06-14 16:01:48.77771366 +0000 UTC m=+509.707361359" Jun 14 16:01:59.991128 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:59.991085 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s"] Jun 14 16:01:59.997689 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:01:59.997662 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.000208 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.000182 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 14 16:02:00.000208 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.000194 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 14 16:02:00.000466 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.000238 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 14 16:02:00.000685 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.000664 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8qhpw\"" Jun 14 16:02:00.001203 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.001185 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 14 16:02:00.014465 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.014432 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s"] Jun 14 16:02:00.127028 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.126987 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/58b744b4-a692-4459-9b5f-7ae25a677aeb-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.127028 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.127025 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/58b744b4-a692-4459-9b5f-7ae25a677aeb-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.127293 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.127128 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/58b744b4-a692-4459-9b5f-7ae25a677aeb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.127293 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.127163 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/58b744b4-a692-4459-9b5f-7ae25a677aeb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.127293 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.127201 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/58b744b4-a692-4459-9b5f-7ae25a677aeb-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.127293 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.127252 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58b744b4-a692-4459-9b5f-7ae25a677aeb-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.127293 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.127281 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hstmd\" (UniqueName: \"kubernetes.io/projected/58b744b4-a692-4459-9b5f-7ae25a677aeb-kube-api-access-hstmd\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.228394 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.228351 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/58b744b4-a692-4459-9b5f-7ae25a677aeb-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.228602 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.228401 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58b744b4-a692-4459-9b5f-7ae25a677aeb-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.228602 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.228424 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hstmd\" (UniqueName: \"kubernetes.io/projected/58b744b4-a692-4459-9b5f-7ae25a677aeb-kube-api-access-hstmd\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.228602 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.228484 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/58b744b4-a692-4459-9b5f-7ae25a677aeb-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.228602 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.228507 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/58b744b4-a692-4459-9b5f-7ae25a677aeb-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.228828 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.228613 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/58b744b4-a692-4459-9b5f-7ae25a677aeb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.228828 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.228642 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/58b744b4-a692-4459-9b5f-7ae25a677aeb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.229471 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.229440 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/58b744b4-a692-4459-9b5f-7ae25a677aeb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.231298 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.231275 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/58b744b4-a692-4459-9b5f-7ae25a677aeb-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.231298 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.231291 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/58b744b4-a692-4459-9b5f-7ae25a677aeb-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.231457 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.231365 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/58b744b4-a692-4459-9b5f-7ae25a677aeb-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.231457 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.231442 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/58b744b4-a692-4459-9b5f-7ae25a677aeb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.248838 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.248762 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58b744b4-a692-4459-9b5f-7ae25a677aeb-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.248838 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.248813 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hstmd\" (UniqueName: \"kubernetes.io/projected/58b744b4-a692-4459-9b5f-7ae25a677aeb-kube-api-access-hstmd\") pod \"istiod-openshift-gateway-75c67f8887-5zp2s\" (UID: \"58b744b4-a692-4459-9b5f-7ae25a677aeb\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.308709 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.308669 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:00.467205 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.467175 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s"] Jun 14 16:02:00.469573 ip-10-0-143-112 kubenswrapper[2528]: W0614 16:02:00.469546 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b744b4_a692_4459_9b5f_7ae25a677aeb.slice/crio-cdc6a6576907a1ab8660c15941ce5b41103e0adbe10af6b14b8a8b731f05527a WatchSource:0}: Error finding container cdc6a6576907a1ab8660c15941ce5b41103e0adbe10af6b14b8a8b731f05527a: Status 404 returned error can't find the container with id cdc6a6576907a1ab8660c15941ce5b41103e0adbe10af6b14b8a8b731f05527a Jun 14 16:02:00.821187 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:00.821147 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" event={"ID":"58b744b4-a692-4459-9b5f-7ae25a677aeb","Type":"ContainerStarted","Data":"cdc6a6576907a1ab8660c15941ce5b41103e0adbe10af6b14b8a8b731f05527a"} Jun 14 16:02:03.521717 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:03.521669 2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 14 16:02:03.522049 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:03.521765 2528 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 14 16:02:03.843099 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:03.843006 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" event={"ID":"58b744b4-a692-4459-9b5f-7ae25a677aeb","Type":"ContainerStarted","Data":"298c04c054bdb24a5e8cb51de75efd866fe1995f726997efbd5c3c374df96478"} Jun 14 16:02:03.843398 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:03.843142 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:03.864711 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:03.864648 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" podStartSLOduration=1.815056577 podStartE2EDuration="4.86463104s" totalImagesPullingTime="3.049574463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:02:03.863473318 +0000 UTC m=+524.793121026" watchObservedRunningTime="2026-06-14 16:02:03.86463104 +0000 UTC m=+524.794278736" Jun 14 16:02:04.684385 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:04.684342 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7fbzc" Jun 14 16:02:04.687691 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:04.687663 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-z726v" Jun 14 16:02:04.851036 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:04.850998 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5zp2s" Jun 14 16:02:52.949246 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:52.949181 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-h4q5w"] Jun 14 16:02:52.952918 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:52.952894 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h4q5w" Jun 14 16:02:52.958926 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:52.958895 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-tfkd2\"" Jun 14 16:02:52.959577 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:52.959555 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 16:02:52.959577 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:52.959570 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 16:02:52.969007 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:52.968966 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-h4q5w"] Jun 14 16:02:53.048369 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:53.048330 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw6j7\" (UniqueName: \"kubernetes.io/projected/fdedf347-6cc5-450d-9235-faff5e69b9fc-kube-api-access-tw6j7\") pod \"authorino-operator-75cc8d5cb7-h4q5w\" (UID: \"fdedf347-6cc5-450d-9235-faff5e69b9fc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-h4q5w" Jun 14 16:02:53.149293 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:53.149248 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw6j7\" (UniqueName: \"kubernetes.io/projected/fdedf347-6cc5-450d-9235-faff5e69b9fc-kube-api-access-tw6j7\") pod \"authorino-operator-75cc8d5cb7-h4q5w\" (UID: \"fdedf347-6cc5-450d-9235-faff5e69b9fc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-h4q5w" Jun 14 16:02:53.163003 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:53.162968 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw6j7\" (UniqueName: \"kubernetes.io/projected/fdedf347-6cc5-450d-9235-faff5e69b9fc-kube-api-access-tw6j7\") pod \"authorino-operator-75cc8d5cb7-h4q5w\" (UID: \"fdedf347-6cc5-450d-9235-faff5e69b9fc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-h4q5w" Jun 14 16:02:53.265196 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:53.265095 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h4q5w" Jun 14 16:02:53.429745 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:53.429715 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-h4q5w"] Jun 14 16:02:53.432829 ip-10-0-143-112 kubenswrapper[2528]: W0614 16:02:53.432806 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdedf347_6cc5_450d_9235_faff5e69b9fc.slice/crio-bfbdaf62d10e410100cbb2760daaaa1b80ecdc2347fc2cace703fd3aff048a87 WatchSource:0}: Error finding container bfbdaf62d10e410100cbb2760daaaa1b80ecdc2347fc2cace703fd3aff048a87: Status 404 returned error can't find the container with id bfbdaf62d10e410100cbb2760daaaa1b80ecdc2347fc2cace703fd3aff048a87 Jun 14 16:02:54.108674 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:54.108616 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h4q5w" event={"ID":"fdedf347-6cc5-450d-9235-faff5e69b9fc","Type":"ContainerStarted","Data":"bfbdaf62d10e410100cbb2760daaaa1b80ecdc2347fc2cace703fd3aff048a87"} Jun 14 16:02:56.121714 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:56.121667 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h4q5w" event={"ID":"fdedf347-6cc5-450d-9235-faff5e69b9fc","Type":"ContainerStarted","Data":"97c5bd72a480cd5116c68539351299bfbed6dcab7af2d5ffd90788b980ea3319"} Jun 14 16:02:56.122119 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:56.121792 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h4q5w" Jun 14 16:02:56.137031 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:02:56.136968 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h4q5w" podStartSLOduration=2.027122749 podStartE2EDuration="4.136933031s" totalImagesPullingTime="2.109810282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:02:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:02:56.136845068 +0000 UTC m=+577.066492768" watchObservedRunningTime="2026-06-14 16:02:56.136933031 +0000 UTC m=+577.066580726" Jun 14 16:03:07.129707 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:07.129676 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h4q5w" Jun 14 16:03:10.584203 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.584164 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pbpxp"] Jun 14 16:03:10.587434 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.587416 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pbpxp" Jun 14 16:03:10.592589 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.592559 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9npls\"" Jun 14 16:03:10.606166 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.606132 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pbpxp"] Jun 14 16:03:10.717187 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.717149 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pbpxp"] Jun 14 16:03:10.717519 ip-10-0-143-112 kubenswrapper[2528]: E0614 16:03:10.717499 2528 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-s26zf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pbpxp" podUID="7de3da74-54a2-4278-aadb-4b16d0fcbfa7" Jun 14 16:03:10.721191 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.721158 2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pbpxp"] Jun 14 16:03:10.727197 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.727169 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7de3da74-54a2-4278-aadb-4b16d0fcbfa7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-pbpxp\" (UID: \"7de3da74-54a2-4278-aadb-4b16d0fcbfa7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pbpxp" Jun 14 16:03:10.727366 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.727266 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s26zf\" (UniqueName: \"kubernetes.io/projected/7de3da74-54a2-4278-aadb-4b16d0fcbfa7-kube-api-access-s26zf\") pod \"kuadrant-operator-controller-manager-55467d9f7-pbpxp\" (UID: \"7de3da74-54a2-4278-aadb-4b16d0fcbfa7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pbpxp" Jun 14 16:03:10.747972 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.747936 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j"] Jun 14 16:03:10.751814 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.751785 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j" Jun 14 16:03:10.772939 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.772893 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j"] Jun 14 16:03:10.828274 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.828233 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7de3da74-54a2-4278-aadb-4b16d0fcbfa7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-pbpxp\" (UID: \"7de3da74-54a2-4278-aadb-4b16d0fcbfa7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pbpxp" Jun 14 16:03:10.828448 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.828344 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s26zf\" (UniqueName: \"kubernetes.io/projected/7de3da74-54a2-4278-aadb-4b16d0fcbfa7-kube-api-access-s26zf\") pod \"kuadrant-operator-controller-manager-55467d9f7-pbpxp\" (UID: \"7de3da74-54a2-4278-aadb-4b16d0fcbfa7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pbpxp" Jun 14 16:03:10.828448 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.828383 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhsj8\" (UniqueName: \"kubernetes.io/projected/7d0ee164-9961-4c1b-bc42-13a4e11e916a-kube-api-access-mhsj8\") pod \"kuadrant-operator-controller-manager-55467d9f7-vcx8j\" (UID: \"7d0ee164-9961-4c1b-bc42-13a4e11e916a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j" Jun 14 16:03:10.828538 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.828470 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d0ee164-9961-4c1b-bc42-13a4e11e916a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-vcx8j\" (UID: \"7d0ee164-9961-4c1b-bc42-13a4e11e916a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j" Jun 14 16:03:10.828641 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.828625 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7de3da74-54a2-4278-aadb-4b16d0fcbfa7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-pbpxp\" (UID: \"7de3da74-54a2-4278-aadb-4b16d0fcbfa7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pbpxp" Jun 14 16:03:10.833905 ip-10-0-143-112 kubenswrapper[2528]: E0614 16:03:10.833876 2528 projected.go:196] Error preparing data for projected volume kube-api-access-s26zf for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pbpxp: failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-pbpxp" not found Jun 14 16:03:10.834048 ip-10-0-143-112 kubenswrapper[2528]: E0614 16:03:10.833956 2528 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7de3da74-54a2-4278-aadb-4b16d0fcbfa7-kube-api-access-s26zf podName:7de3da74-54a2-4278-aadb-4b16d0fcbfa7 nodeName:}" failed. No retries permitted until 2026-06-14 16:03:11.333938441 +0000 UTC m=+592.263586114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s26zf" (UniqueName: "kubernetes.io/projected/7de3da74-54a2-4278-aadb-4b16d0fcbfa7-kube-api-access-s26zf") pod "kuadrant-operator-controller-manager-55467d9f7-pbpxp" (UID: "7de3da74-54a2-4278-aadb-4b16d0fcbfa7") : failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-pbpxp" not found Jun 14 16:03:10.929575 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.929529 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhsj8\" (UniqueName: \"kubernetes.io/projected/7d0ee164-9961-4c1b-bc42-13a4e11e916a-kube-api-access-mhsj8\") pod \"kuadrant-operator-controller-manager-55467d9f7-vcx8j\" (UID: \"7d0ee164-9961-4c1b-bc42-13a4e11e916a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j" Jun 14 16:03:10.929755 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.929631 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d0ee164-9961-4c1b-bc42-13a4e11e916a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-vcx8j\" (UID: \"7d0ee164-9961-4c1b-bc42-13a4e11e916a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j" Jun 14 16:03:10.930038 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.930019 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d0ee164-9961-4c1b-bc42-13a4e11e916a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-vcx8j\" (UID: \"7d0ee164-9961-4c1b-bc42-13a4e11e916a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j" Jun 14 16:03:10.941571 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:10.941540 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhsj8\" (UniqueName: \"kubernetes.io/projected/7d0ee164-9961-4c1b-bc42-13a4e11e916a-kube-api-access-mhsj8\") pod \"kuadrant-operator-controller-manager-55467d9f7-vcx8j\" (UID: \"7d0ee164-9961-4c1b-bc42-13a4e11e916a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j" Jun 14 16:03:11.064815 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:11.064757 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j" Jun 14 16:03:11.204590 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:11.204492 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pbpxp" Jun 14 16:03:11.209688 ip-10-0-143-112 kubenswrapper[2528]: E0614 16:03:11.209650 2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-pbpxp\" is forbidden: User \"system:node:ip-10-0-143-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-112.ec2.internal' and this object" podUID="7de3da74-54a2-4278-aadb-4b16d0fcbfa7" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pbpxp" Jun 14 16:03:11.213956 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:11.213925 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pbpxp" Jun 14 16:03:11.215906 ip-10-0-143-112 kubenswrapper[2528]: E0614 16:03:11.215872 2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-pbpxp\" is forbidden: User \"system:node:ip-10-0-143-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-112.ec2.internal' and this object" podUID="7de3da74-54a2-4278-aadb-4b16d0fcbfa7" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pbpxp" Jun 14 16:03:11.224412 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:11.224381 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j"] Jun 14 16:03:11.227162 ip-10-0-143-112 kubenswrapper[2528]: W0614 16:03:11.227137 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d0ee164_9961_4c1b_bc42_13a4e11e916a.slice/crio-1a62234673c43492df76e078fb90a9721506c2c3df08f8817616582fb235a10a WatchSource:0}: Error finding container 1a62234673c43492df76e078fb90a9721506c2c3df08f8817616582fb235a10a: Status 404 returned error can't find the container with id 1a62234673c43492df76e078fb90a9721506c2c3df08f8817616582fb235a10a Jun 14 16:03:11.334542 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:11.334498 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7de3da74-54a2-4278-aadb-4b16d0fcbfa7-extensions-socket-volume\") pod \"7de3da74-54a2-4278-aadb-4b16d0fcbfa7\" (UID: \"7de3da74-54a2-4278-aadb-4b16d0fcbfa7\") " Jun 14 16:03:11.334717 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:11.334707 2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s26zf\" (UniqueName: \"kubernetes.io/projected/7de3da74-54a2-4278-aadb-4b16d0fcbfa7-kube-api-access-s26zf\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 14 16:03:11.334806 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:11.334781 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de3da74-54a2-4278-aadb-4b16d0fcbfa7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7de3da74-54a2-4278-aadb-4b16d0fcbfa7" (UID: "7de3da74-54a2-4278-aadb-4b16d0fcbfa7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 16:03:11.435810 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:11.435767 2528 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7de3da74-54a2-4278-aadb-4b16d0fcbfa7-extensions-socket-volume\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 14 16:03:11.578516 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:11.574310 2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7de3da74-54a2-4278-aadb-4b16d0fcbfa7" path="/var/lib/kubelet/pods/7de3da74-54a2-4278-aadb-4b16d0fcbfa7/volumes" Jun 14 16:03:12.214618 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:12.214571 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pbpxp" Jun 14 16:03:12.215078 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:12.214657 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j" event={"ID":"7d0ee164-9961-4c1b-bc42-13a4e11e916a","Type":"ContainerStarted","Data":"1a62234673c43492df76e078fb90a9721506c2c3df08f8817616582fb235a10a"} Jun 14 16:03:12.219824 ip-10-0-143-112 kubenswrapper[2528]: E0614 16:03:12.219782 2528 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-pbpxp\" is forbidden: User \"system:node:ip-10-0-143-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-112.ec2.internal' and this object" podUID="7de3da74-54a2-4278-aadb-4b16d0fcbfa7" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-pbpxp" Jun 14 16:03:17.245163 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:17.245120 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j" event={"ID":"7d0ee164-9961-4c1b-bc42-13a4e11e916a","Type":"ContainerStarted","Data":"23f42459828f7f4409a8f61b7cac824c082e0a76dcbf4028cb41db875167a0d8"} Jun 14 16:03:17.245621 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:17.245258 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j" Jun 14 16:03:17.318466 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:17.318411 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j" podStartSLOduration=2.174263035 podStartE2EDuration="7.318392519s" totalImagesPullingTime="5.144129484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:03:17.31438518 +0000 UTC m=+598.244032886" watchObservedRunningTime="2026-06-14 16:03:17.318392519 +0000 UTC m=+598.248040213" Jun 14 16:03:19.575368 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:19.575338 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b5tmd_80523acb-bab6-4e11-83b3-35af2852be80/console-operator/1.log" Jun 14 16:03:19.575890 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:19.575866 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b5tmd_80523acb-bab6-4e11-83b3-35af2852be80/console-operator/1.log" Jun 14 16:03:23.234190 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:23.234153 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j"] Jun 14 16:03:23.234675 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:23.234411 2528 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j" podUID="7d0ee164-9961-4c1b-bc42-13a4e11e916a" containerName="manager" containerID="cri-o://23f42459828f7f4409a8f61b7cac824c082e0a76dcbf4028cb41db875167a0d8" gracePeriod=10 Jun 14 16:03:23.236154 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:23.236133 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j" Jun 14 16:03:23.488486 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:23.488403 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j" Jun 14 16:03:23.557817 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:23.557776 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhsj8\" (UniqueName: \"kubernetes.io/projected/7d0ee164-9961-4c1b-bc42-13a4e11e916a-kube-api-access-mhsj8\") pod \"7d0ee164-9961-4c1b-bc42-13a4e11e916a\" (UID: \"7d0ee164-9961-4c1b-bc42-13a4e11e916a\") " Jun 14 16:03:23.558015 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:23.557835 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d0ee164-9961-4c1b-bc42-13a4e11e916a-extensions-socket-volume\") pod \"7d0ee164-9961-4c1b-bc42-13a4e11e916a\" (UID: \"7d0ee164-9961-4c1b-bc42-13a4e11e916a\") " Jun 14 16:03:23.558275 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:23.558225 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d0ee164-9961-4c1b-bc42-13a4e11e916a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7d0ee164-9961-4c1b-bc42-13a4e11e916a" (UID: "7d0ee164-9961-4c1b-bc42-13a4e11e916a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 16:03:23.560327 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:23.560294 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d0ee164-9961-4c1b-bc42-13a4e11e916a-kube-api-access-mhsj8" (OuterVolumeSpecName: "kube-api-access-mhsj8") pod "7d0ee164-9961-4c1b-bc42-13a4e11e916a" (UID: "7d0ee164-9961-4c1b-bc42-13a4e11e916a"). InnerVolumeSpecName "kube-api-access-mhsj8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:03:23.659486 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:23.659446 2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhsj8\" (UniqueName: \"kubernetes.io/projected/7d0ee164-9961-4c1b-bc42-13a4e11e916a-kube-api-access-mhsj8\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 14 16:03:23.659486 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:23.659482 2528 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d0ee164-9961-4c1b-bc42-13a4e11e916a-extensions-socket-volume\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 14 16:03:24.290126 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:24.290087 2528 generic.go:356] "Generic (PLEG): container finished" podID="7d0ee164-9961-4c1b-bc42-13a4e11e916a" containerID="23f42459828f7f4409a8f61b7cac824c082e0a76dcbf4028cb41db875167a0d8" exitCode=0 Jun 14 16:03:24.290551 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:24.290153 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j" Jun 14 16:03:24.290551 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:24.290178 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j" event={"ID":"7d0ee164-9961-4c1b-bc42-13a4e11e916a","Type":"ContainerDied","Data":"23f42459828f7f4409a8f61b7cac824c082e0a76dcbf4028cb41db875167a0d8"} Jun 14 16:03:24.290551 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:24.290251 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j" event={"ID":"7d0ee164-9961-4c1b-bc42-13a4e11e916a","Type":"ContainerDied","Data":"1a62234673c43492df76e078fb90a9721506c2c3df08f8817616582fb235a10a"} Jun 14 16:03:24.290551 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:24.290274 2528 scope.go:117] "RemoveContainer" containerID="23f42459828f7f4409a8f61b7cac824c082e0a76dcbf4028cb41db875167a0d8" Jun 14 16:03:24.300350 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:24.300329 2528 scope.go:117] "RemoveContainer" containerID="23f42459828f7f4409a8f61b7cac824c082e0a76dcbf4028cb41db875167a0d8" Jun 14 16:03:24.300694 ip-10-0-143-112 kubenswrapper[2528]: E0614 16:03:24.300673 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23f42459828f7f4409a8f61b7cac824c082e0a76dcbf4028cb41db875167a0d8\": container with ID starting with 23f42459828f7f4409a8f61b7cac824c082e0a76dcbf4028cb41db875167a0d8 not found: ID does not exist" containerID="23f42459828f7f4409a8f61b7cac824c082e0a76dcbf4028cb41db875167a0d8" Jun 14 16:03:24.300768 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:24.300705 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23f42459828f7f4409a8f61b7cac824c082e0a76dcbf4028cb41db875167a0d8"} err="failed to get container status \"23f42459828f7f4409a8f61b7cac824c082e0a76dcbf4028cb41db875167a0d8\": rpc error: code = NotFound desc = could not find container \"23f42459828f7f4409a8f61b7cac824c082e0a76dcbf4028cb41db875167a0d8\": container with ID starting with 23f42459828f7f4409a8f61b7cac824c082e0a76dcbf4028cb41db875167a0d8 not found: ID does not exist" Jun 14 16:03:24.312765 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:24.312730 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j"] Jun 14 16:03:24.328513 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:24.328473 2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vcx8j"] Jun 14 16:03:25.572858 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:25.572827 2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d0ee164-9961-4c1b-bc42-13a4e11e916a" path="/var/lib/kubelet/pods/7d0ee164-9961-4c1b-bc42-13a4e11e916a/volumes" Jun 14 16:03:41.412272 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:41.412154 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zrd7j"] Jun 14 16:03:41.412640 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:41.412605 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d0ee164-9961-4c1b-bc42-13a4e11e916a" containerName="manager" Jun 14 16:03:41.412640 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:41.412617 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d0ee164-9961-4c1b-bc42-13a4e11e916a" containerName="manager" Jun 14 16:03:41.412772 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:41.412685 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d0ee164-9961-4c1b-bc42-13a4e11e916a" containerName="manager" Jun 14 16:03:41.416124 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:41.416098 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zrd7j" Jun 14 16:03:41.419237 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:41.419201 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 14 16:03:41.419375 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:41.419334 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7kxjs\"" Jun 14 16:03:41.425842 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:41.425818 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zrd7j"] Jun 14 16:03:41.507679 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:41.507642 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zrd7j"] Jun 14 16:03:41.534698 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:41.534657 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94df2394-a769-48f2-9763-7f9d274db6df-config-file\") pod \"limitador-limitador-64c94fd64f-zrd7j\" (UID: \"94df2394-a769-48f2-9763-7f9d274db6df\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zrd7j" Jun 14 16:03:41.534872 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:41.534776 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rsng\" (UniqueName: \"kubernetes.io/projected/94df2394-a769-48f2-9763-7f9d274db6df-kube-api-access-2rsng\") pod \"limitador-limitador-64c94fd64f-zrd7j\" (UID: \"94df2394-a769-48f2-9763-7f9d274db6df\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zrd7j" Jun 14 16:03:41.636234 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:41.636182 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94df2394-a769-48f2-9763-7f9d274db6df-config-file\") pod \"limitador-limitador-64c94fd64f-zrd7j\" (UID: \"94df2394-a769-48f2-9763-7f9d274db6df\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zrd7j" Jun 14 16:03:41.636446 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:41.636325 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rsng\" (UniqueName: \"kubernetes.io/projected/94df2394-a769-48f2-9763-7f9d274db6df-kube-api-access-2rsng\") pod \"limitador-limitador-64c94fd64f-zrd7j\" (UID: \"94df2394-a769-48f2-9763-7f9d274db6df\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zrd7j" Jun 14 16:03:41.636911 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:41.636886 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94df2394-a769-48f2-9763-7f9d274db6df-config-file\") pod \"limitador-limitador-64c94fd64f-zrd7j\" (UID: \"94df2394-a769-48f2-9763-7f9d274db6df\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zrd7j" Jun 14 16:03:41.644744 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:41.644713 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rsng\" (UniqueName: \"kubernetes.io/projected/94df2394-a769-48f2-9763-7f9d274db6df-kube-api-access-2rsng\") pod \"limitador-limitador-64c94fd64f-zrd7j\" (UID: \"94df2394-a769-48f2-9763-7f9d274db6df\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zrd7j" Jun 14 16:03:41.727364 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:41.727268 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zrd7j" Jun 14 16:03:41.889199 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:41.889173 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zrd7j"] Jun 14 16:03:41.891502 ip-10-0-143-112 kubenswrapper[2528]: W0614 16:03:41.891473 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94df2394_a769_48f2_9763_7f9d274db6df.slice/crio-6294d8d04118f339b556cec0220634fd06b4d5559a6bd5733cd977d95c50d9fb WatchSource:0}: Error finding container 6294d8d04118f339b556cec0220634fd06b4d5559a6bd5733cd977d95c50d9fb: Status 404 returned error can't find the container with id 6294d8d04118f339b556cec0220634fd06b4d5559a6bd5733cd977d95c50d9fb Jun 14 16:03:42.386517 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:42.386474 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zrd7j" event={"ID":"94df2394-a769-48f2-9763-7f9d274db6df","Type":"ContainerStarted","Data":"6294d8d04118f339b556cec0220634fd06b4d5559a6bd5733cd977d95c50d9fb"} Jun 14 16:03:45.405752 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:45.405716 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zrd7j" event={"ID":"94df2394-a769-48f2-9763-7f9d274db6df","Type":"ContainerStarted","Data":"8b452d40f533ebcfa677bffa1f2d1b5c5c792b2b8d2fa8e1f2b12011e21a508e"} Jun 14 16:03:45.406147 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:45.405860 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zrd7j" Jun 14 16:03:45.429453 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:45.429396 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zrd7j" podStartSLOduration=1.7313235580000002 podStartE2EDuration="4.429378819s" totalImagesPullingTime="2.698055261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:03:45.427835711 +0000 UTC m=+626.357483397" watchObservedRunningTime="2026-06-14 16:03:45.429378819 +0000 UTC m=+626.359026527" Jun 14 16:03:56.412613 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:56.412578 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zrd7j" Jun 14 16:03:58.264705 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:58.264662 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zrd7j"] Jun 14 16:03:58.265178 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:58.264869 2528 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zrd7j" podUID="94df2394-a769-48f2-9763-7f9d274db6df" containerName="limitador" containerID="cri-o://8b452d40f533ebcfa677bffa1f2d1b5c5c792b2b8d2fa8e1f2b12011e21a508e" gracePeriod=30 Jun 14 16:03:59.225360 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:59.225331 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zrd7j" Jun 14 16:03:59.318921 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:59.318876 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94df2394-a769-48f2-9763-7f9d274db6df-config-file\") pod \"94df2394-a769-48f2-9763-7f9d274db6df\" (UID: \"94df2394-a769-48f2-9763-7f9d274db6df\") " Jun 14 16:03:59.318921 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:59.318928 2528 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rsng\" (UniqueName: \"kubernetes.io/projected/94df2394-a769-48f2-9763-7f9d274db6df-kube-api-access-2rsng\") pod \"94df2394-a769-48f2-9763-7f9d274db6df\" (UID: \"94df2394-a769-48f2-9763-7f9d274db6df\") " Jun 14 16:03:59.319456 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:59.319291 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94df2394-a769-48f2-9763-7f9d274db6df-config-file" (OuterVolumeSpecName: "config-file") pod "94df2394-a769-48f2-9763-7f9d274db6df" (UID: "94df2394-a769-48f2-9763-7f9d274db6df"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 16:03:59.321207 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:59.321183 2528 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94df2394-a769-48f2-9763-7f9d274db6df-kube-api-access-2rsng" (OuterVolumeSpecName: "kube-api-access-2rsng") pod "94df2394-a769-48f2-9763-7f9d274db6df" (UID: "94df2394-a769-48f2-9763-7f9d274db6df"). InnerVolumeSpecName "kube-api-access-2rsng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 16:03:59.420448 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:59.420407 2528 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94df2394-a769-48f2-9763-7f9d274db6df-config-file\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 14 16:03:59.420448 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:59.420441 2528 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rsng\" (UniqueName: \"kubernetes.io/projected/94df2394-a769-48f2-9763-7f9d274db6df-kube-api-access-2rsng\") on node \"ip-10-0-143-112.ec2.internal\" DevicePath \"\"" Jun 14 16:03:59.488122 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:59.488085 2528 generic.go:356] "Generic (PLEG): container finished" podID="94df2394-a769-48f2-9763-7f9d274db6df" containerID="8b452d40f533ebcfa677bffa1f2d1b5c5c792b2b8d2fa8e1f2b12011e21a508e" exitCode=0 Jun 14 16:03:59.488335 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:59.488128 2528 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zrd7j" Jun 14 16:03:59.488335 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:59.488183 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zrd7j" event={"ID":"94df2394-a769-48f2-9763-7f9d274db6df","Type":"ContainerDied","Data":"8b452d40f533ebcfa677bffa1f2d1b5c5c792b2b8d2fa8e1f2b12011e21a508e"} Jun 14 16:03:59.488335 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:59.488249 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zrd7j" event={"ID":"94df2394-a769-48f2-9763-7f9d274db6df","Type":"ContainerDied","Data":"6294d8d04118f339b556cec0220634fd06b4d5559a6bd5733cd977d95c50d9fb"} Jun 14 16:03:59.488335 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:59.488274 2528 scope.go:117] "RemoveContainer" containerID="8b452d40f533ebcfa677bffa1f2d1b5c5c792b2b8d2fa8e1f2b12011e21a508e" Jun 14 16:03:59.497641 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:59.497617 2528 scope.go:117] "RemoveContainer" containerID="8b452d40f533ebcfa677bffa1f2d1b5c5c792b2b8d2fa8e1f2b12011e21a508e" Jun 14 16:03:59.497938 ip-10-0-143-112 kubenswrapper[2528]: E0614 16:03:59.497919 2528 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b452d40f533ebcfa677bffa1f2d1b5c5c792b2b8d2fa8e1f2b12011e21a508e\": container with ID starting with 8b452d40f533ebcfa677bffa1f2d1b5c5c792b2b8d2fa8e1f2b12011e21a508e not found: ID does not exist" containerID="8b452d40f533ebcfa677bffa1f2d1b5c5c792b2b8d2fa8e1f2b12011e21a508e" Jun 14 16:03:59.497985 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:59.497947 2528 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b452d40f533ebcfa677bffa1f2d1b5c5c792b2b8d2fa8e1f2b12011e21a508e"} err="failed to get container status \"8b452d40f533ebcfa677bffa1f2d1b5c5c792b2b8d2fa8e1f2b12011e21a508e\": rpc error: code = NotFound desc = could not find container \"8b452d40f533ebcfa677bffa1f2d1b5c5c792b2b8d2fa8e1f2b12011e21a508e\": container with ID starting with 8b452d40f533ebcfa677bffa1f2d1b5c5c792b2b8d2fa8e1f2b12011e21a508e not found: ID does not exist" Jun 14 16:03:59.509273 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:59.509239 2528 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zrd7j"] Jun 14 16:03:59.513830 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:59.513798 2528 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zrd7j"] Jun 14 16:03:59.572918 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:03:59.572888 2528 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94df2394-a769-48f2-9763-7f9d274db6df" path="/var/lib/kubelet/pods/94df2394-a769-48f2-9763-7f9d274db6df/volumes" Jun 14 16:04:02.854502 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:02.854464 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-wqpfq"] Jun 14 16:04:02.855085 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:02.855017 2528 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94df2394-a769-48f2-9763-7f9d274db6df" containerName="limitador" Jun 14 16:04:02.855085 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:02.855046 2528 state_mem.go:107] "Deleted CPUSet assignment" podUID="94df2394-a769-48f2-9763-7f9d274db6df" containerName="limitador" Jun 14 16:04:02.855323 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:02.855155 2528 memory_manager.go:368] "RemoveStaleState removing state" podUID="94df2394-a769-48f2-9763-7f9d274db6df" containerName="limitador" Jun 14 16:04:02.859055 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:02.859029 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-wqpfq" Jun 14 16:04:02.861059 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:02.861036 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 14 16:04:02.868693 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:02.868658 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-wqpfq"] Jun 14 16:04:02.954644 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:02.954603 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cspf\" (UniqueName: \"kubernetes.io/projected/08b450e2-e5de-48cf-a206-3d7c55233faa-kube-api-access-2cspf\") pod \"postgres-69fb4594cf-wqpfq\" (UID: \"08b450e2-e5de-48cf-a206-3d7c55233faa\") " pod="opendatahub/postgres-69fb4594cf-wqpfq" Jun 14 16:04:02.954838 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:02.954694 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/08b450e2-e5de-48cf-a206-3d7c55233faa-data\") pod \"postgres-69fb4594cf-wqpfq\" (UID: \"08b450e2-e5de-48cf-a206-3d7c55233faa\") " pod="opendatahub/postgres-69fb4594cf-wqpfq" Jun 14 16:04:03.055590 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:03.055548 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/08b450e2-e5de-48cf-a206-3d7c55233faa-data\") pod \"postgres-69fb4594cf-wqpfq\" (UID: \"08b450e2-e5de-48cf-a206-3d7c55233faa\") " pod="opendatahub/postgres-69fb4594cf-wqpfq" Jun 14 16:04:03.055772 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:03.055641 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cspf\" (UniqueName: \"kubernetes.io/projected/08b450e2-e5de-48cf-a206-3d7c55233faa-kube-api-access-2cspf\") pod \"postgres-69fb4594cf-wqpfq\" (UID: \"08b450e2-e5de-48cf-a206-3d7c55233faa\") " pod="opendatahub/postgres-69fb4594cf-wqpfq" Jun 14 16:04:03.055948 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:03.055927 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/08b450e2-e5de-48cf-a206-3d7c55233faa-data\") pod \"postgres-69fb4594cf-wqpfq\" (UID: \"08b450e2-e5de-48cf-a206-3d7c55233faa\") " pod="opendatahub/postgres-69fb4594cf-wqpfq" Jun 14 16:04:03.064270 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:03.064208 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cspf\" (UniqueName: \"kubernetes.io/projected/08b450e2-e5de-48cf-a206-3d7c55233faa-kube-api-access-2cspf\") pod \"postgres-69fb4594cf-wqpfq\" (UID: \"08b450e2-e5de-48cf-a206-3d7c55233faa\") " pod="opendatahub/postgres-69fb4594cf-wqpfq" Jun 14 16:04:03.172070 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:03.172037 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-wqpfq" Jun 14 16:04:03.309576 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:03.309549 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-wqpfq"] Jun 14 16:04:03.311577 ip-10-0-143-112 kubenswrapper[2528]: W0614 16:04:03.311549 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b450e2_e5de_48cf_a206_3d7c55233faa.slice/crio-9984c26154bc9538e77dc40bb4421f25956cf5cb72bb9fc86aa0026f7376575b WatchSource:0}: Error finding container 9984c26154bc9538e77dc40bb4421f25956cf5cb72bb9fc86aa0026f7376575b: Status 404 returned error can't find the container with id 9984c26154bc9538e77dc40bb4421f25956cf5cb72bb9fc86aa0026f7376575b Jun 14 16:04:03.514579 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:03.514490 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-wqpfq" event={"ID":"08b450e2-e5de-48cf-a206-3d7c55233faa","Type":"ContainerStarted","Data":"9984c26154bc9538e77dc40bb4421f25956cf5cb72bb9fc86aa0026f7376575b"} Jun 14 16:04:05.527734 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:05.527700 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-wqpfq" event={"ID":"08b450e2-e5de-48cf-a206-3d7c55233faa","Type":"ContainerStarted","Data":"ab54ac2eae8c0f9da246e4f716d1cb6e32437da8ad8ae8466a0a8d6f4a09cd4a"} Jun 14 16:04:05.528171 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:05.527789 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-wqpfq" Jun 14 16:04:05.546722 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:05.546663 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-wqpfq" podStartSLOduration=1.423087442 podStartE2EDuration="3.546641611s" totalImagesPullingTime="2.123554169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:04:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:04:05.545736766 +0000 UTC m=+646.475384462" watchObservedRunningTime="2026-06-14 16:04:05.546641611 +0000 UTC m=+646.476289307" Jun 14 16:04:11.573200 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:11.573167 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-wqpfq" Jun 14 16:04:22.221384 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:22.221341 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-nmtmj"] Jun 14 16:04:22.230207 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:22.230185 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-nmtmj" Jun 14 16:04:22.236778 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:22.236724 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-7khc5\"" Jun 14 16:04:22.236778 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:22.236751 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 14 16:04:22.237359 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:22.237102 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 14 16:04:22.245510 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:22.245487 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-nmtmj"] Jun 14 16:04:22.346365 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:22.346329 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2j4l\" (UniqueName: \"kubernetes.io/projected/abaf9f6a-b29f-440c-bf99-14aaf1f0331b-kube-api-access-t2j4l\") pod \"keycloak-operator-d67dbbb48-nmtmj\" (UID: \"abaf9f6a-b29f-440c-bf99-14aaf1f0331b\") " pod="keycloak-system/keycloak-operator-d67dbbb48-nmtmj" Jun 14 16:04:22.447629 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:22.447585 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2j4l\" (UniqueName: \"kubernetes.io/projected/abaf9f6a-b29f-440c-bf99-14aaf1f0331b-kube-api-access-t2j4l\") pod \"keycloak-operator-d67dbbb48-nmtmj\" (UID: \"abaf9f6a-b29f-440c-bf99-14aaf1f0331b\") " pod="keycloak-system/keycloak-operator-d67dbbb48-nmtmj" Jun 14 16:04:22.462978 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:22.462938 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2j4l\" (UniqueName: \"kubernetes.io/projected/abaf9f6a-b29f-440c-bf99-14aaf1f0331b-kube-api-access-t2j4l\") pod \"keycloak-operator-d67dbbb48-nmtmj\" (UID: \"abaf9f6a-b29f-440c-bf99-14aaf1f0331b\") " pod="keycloak-system/keycloak-operator-d67dbbb48-nmtmj" Jun 14 16:04:22.540779 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:22.540695 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-nmtmj" Jun 14 16:04:22.711338 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:22.711310 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-nmtmj"] Jun 14 16:04:22.713504 ip-10-0-143-112 kubenswrapper[2528]: W0614 16:04:22.713464 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabaf9f6a_b29f_440c_bf99_14aaf1f0331b.slice/crio-4f9be815bdb921c5e2b4ff1e1c87e693c953155c9a8a62136cbac75418011b28 WatchSource:0}: Error finding container 4f9be815bdb921c5e2b4ff1e1c87e693c953155c9a8a62136cbac75418011b28: Status 404 returned error can't find the container with id 4f9be815bdb921c5e2b4ff1e1c87e693c953155c9a8a62136cbac75418011b28 Jun 14 16:04:23.631939 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:23.631900 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-nmtmj" event={"ID":"abaf9f6a-b29f-440c-bf99-14aaf1f0331b","Type":"ContainerStarted","Data":"4f9be815bdb921c5e2b4ff1e1c87e693c953155c9a8a62136cbac75418011b28"} Jun 14 16:04:29.671337 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:29.671301 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-nmtmj" event={"ID":"abaf9f6a-b29f-440c-bf99-14aaf1f0331b","Type":"ContainerStarted","Data":"b834b35970ce4bfa1b02e2b55994ac2e84a8018e8f2404dd8a25ce2ac357def5"} Jun 14 16:04:29.688482 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:04:29.688427 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-nmtmj" podStartSLOduration=1.499266521 podStartE2EDuration="7.68840995s" totalImagesPullingTime="6.189143429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 16:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:04:29.686927552 +0000 UTC m=+670.616575247" watchObservedRunningTime="2026-06-14 16:04:29.68840995 +0000 UTC m=+670.618057689" Jun 14 16:07:17.190110 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:17.190059 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6cc8f74cbf-tr6dh_efb9efd2-6d01-4c5a-86b1-e14cd88eb234/nginx/0.log" Jun 14 16:07:17.308030 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:17.307968 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-z726v_900b1f9f-db30-4d6a-ad0a-d73d70fa09b9/manager/0.log" Jun 14 16:07:17.419119 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:17.419087 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-7fbzc_9b34a062-4bc4-414e-81d2-dfef087c886f/manager/0.log" Jun 14 16:07:17.768818 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:17.768788 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-85cpb_581cd7bb-0c45-4d34-afff-2d7f81bd1db1/server/0.log" Jun 14 16:07:17.889963 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:17.889893 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-4v4wf_f01adee1-5764-4ed5-b545-0c2d9a7e18d7/manager/0.log" Jun 14 16:07:18.123642 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:18.123568 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6669f54779-b2drp_fa0f63df-8bb6-4536-a575-628a5d56085b/copy-manifests/0.log" Jun 14 16:07:18.144424 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:18.144395 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6669f54779-b2drp_fa0f63df-8bb6-4536-a575-628a5d56085b/manager/0.log" Jun 14 16:07:18.387276 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:18.387245 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-wqpfq_08b450e2-e5de-48cf-a206-3d7c55233faa/postgres/0.log" Jun 14 16:07:19.628114 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:19.628083 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-h4q5w_fdedf347-6cc5-450d-9235-faff5e69b9fc/manager/0.log" Jun 14 16:07:20.771531 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:20.771497 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5zp2s_58b744b4-a692-4459-9b5f-7ae25a677aeb/discovery/0.log" Jun 14 16:07:21.004092 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:21.004060 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d56d8dc9f-f5nzd_59970e23-03fa-4641-afd5-560a91675fcb/kube-auth-proxy/0.log" Jun 14 16:07:27.914404 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:27.914375 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w9q49_07df90f6-3e95-433f-bce9-29fb97c0fb35/global-pull-secret-syncer/0.log" Jun 14 16:07:28.027827 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:28.027794 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6jp7n_549f07ae-a352-4940-bc1e-5f4e737b95c2/konnectivity-agent/0.log" Jun 14 16:07:28.116710 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:28.116655 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-112.ec2.internal_c8e3889a791d0c7f22f6182a8170d3ff/haproxy/0.log" Jun 14 16:07:33.330779 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:33.330683 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-h4q5w_fdedf347-6cc5-450d-9235-faff5e69b9fc/manager/0.log" Jun 14 16:07:34.892176 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:34.892146 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a56fbb5-b835-40e7-8257-addf757e45b1/alertmanager/0.log" Jun 14 16:07:34.915398 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:34.915340 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a56fbb5-b835-40e7-8257-addf757e45b1/config-reloader/0.log" Jun 14 16:07:34.934552 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:34.934506 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a56fbb5-b835-40e7-8257-addf757e45b1/kube-rbac-proxy-web/0.log" Jun 14 16:07:34.957871 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:34.957757 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a56fbb5-b835-40e7-8257-addf757e45b1/kube-rbac-proxy/0.log" Jun 14 16:07:34.984852 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:34.984824 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a56fbb5-b835-40e7-8257-addf757e45b1/kube-rbac-proxy-metric/0.log" Jun 14 16:07:35.004006 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.003973 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a56fbb5-b835-40e7-8257-addf757e45b1/prom-label-proxy/0.log" Jun 14 16:07:35.026389 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.026360 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a56fbb5-b835-40e7-8257-addf757e45b1/init-config-reloader/0.log" Jun 14 16:07:35.069617 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.069588 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-wm26v_0cb84e67-7dda-4d59-9e09-56e18da9d6a9/cluster-monitoring-operator/0.log" Jun 14 16:07:35.159100 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.159069 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-d64d84bff-hfv4c_4f9a779f-2ffc-4f22-bde4-e6d434754e3c/metrics-server/0.log" Jun 14 16:07:35.184959 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.184924 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-h7stp_68e8d5a6-e1f4-474c-8339-6c53500da532/monitoring-plugin/0.log" Jun 14 16:07:35.282123 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.282040 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n69lv_7db11eea-9e0f-49fd-8ffd-0620c1136a10/node-exporter/0.log" Jun 14 16:07:35.307258 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.307230 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n69lv_7db11eea-9e0f-49fd-8ffd-0620c1136a10/kube-rbac-proxy/0.log" Jun 14 16:07:35.330819 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.330788 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n69lv_7db11eea-9e0f-49fd-8ffd-0620c1136a10/init-textfile/0.log" Jun 14 16:07:35.456337 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.456309 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-2cf7r_5409def3-4053-4c2a-8fae-26b60970c0fc/kube-rbac-proxy-main/0.log" Jun 14 16:07:35.482117 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.482063 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-2cf7r_5409def3-4053-4c2a-8fae-26b60970c0fc/kube-rbac-proxy-self/0.log" Jun 14 16:07:35.514444 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.514415 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-2cf7r_5409def3-4053-4c2a-8fae-26b60970c0fc/openshift-state-metrics/0.log" Jun 14 16:07:35.554319 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.554285 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a07e7acc-e11e-46b2-ae2a-72bc71f36cf5/prometheus/0.log" Jun 14 16:07:35.593931 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.593905 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a07e7acc-e11e-46b2-ae2a-72bc71f36cf5/config-reloader/0.log" Jun 14 16:07:35.616138 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.616106 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a07e7acc-e11e-46b2-ae2a-72bc71f36cf5/thanos-sidecar/0.log" Jun 14 16:07:35.641471 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.641440 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a07e7acc-e11e-46b2-ae2a-72bc71f36cf5/kube-rbac-proxy-web/0.log" Jun 14 16:07:35.688541 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.688509 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a07e7acc-e11e-46b2-ae2a-72bc71f36cf5/kube-rbac-proxy/0.log" Jun 14 16:07:35.734153 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.734124 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a07e7acc-e11e-46b2-ae2a-72bc71f36cf5/kube-rbac-proxy-thanos/0.log" Jun 14 16:07:35.781260 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.781207 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a07e7acc-e11e-46b2-ae2a-72bc71f36cf5/init-config-reloader/0.log" Jun 14 16:07:35.826958 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.826879 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-zlszg_1dd57825-fa2f-488b-a894-787b30229c8a/prometheus-operator/0.log" Jun 14 16:07:35.847271 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.847243 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-zlszg_1dd57825-fa2f-488b-a894-787b30229c8a/kube-rbac-proxy/0.log" Jun 14 16:07:35.873087 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:35.873060 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-84c22_8c33d570-44c8-430e-8a85-45ec4e60bf12/prometheus-operator-admission-webhook/0.log" Jun 14 16:07:36.015262 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:36.015233 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856c55d9f5-v5gxt_eeec13cb-d8d1-47e0-9da9-af84d8703f16/thanos-query/0.log" Jun 14 16:07:36.045100 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:36.045071 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856c55d9f5-v5gxt_eeec13cb-d8d1-47e0-9da9-af84d8703f16/kube-rbac-proxy-web/0.log" Jun 14 16:07:36.069257 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:36.069199 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856c55d9f5-v5gxt_eeec13cb-d8d1-47e0-9da9-af84d8703f16/kube-rbac-proxy/0.log" Jun 14 16:07:36.089773 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:36.089692 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856c55d9f5-v5gxt_eeec13cb-d8d1-47e0-9da9-af84d8703f16/prom-label-proxy/0.log" Jun 14 16:07:36.110285 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:36.110250 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856c55d9f5-v5gxt_eeec13cb-d8d1-47e0-9da9-af84d8703f16/kube-rbac-proxy-rules/0.log" Jun 14 16:07:36.130170 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:36.130130 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856c55d9f5-v5gxt_eeec13cb-d8d1-47e0-9da9-af84d8703f16/kube-rbac-proxy-metrics/0.log" Jun 14 16:07:38.004395 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.004365 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b5tmd_80523acb-bab6-4e11-83b3-35af2852be80/console-operator/1.log" Jun 14 16:07:38.012691 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.012655 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b5tmd_80523acb-bab6-4e11-83b3-35af2852be80/console-operator/2.log" Jun 14 16:07:38.323008 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.322933 2528 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf"] Jun 14 16:07:38.327727 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.327706 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:38.329670 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.329642 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mtkvt\"/\"openshift-service-ca.crt\"" Jun 14 16:07:38.331050 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.330095 2528 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mtkvt\"/\"kube-root-ca.crt\"" Jun 14 16:07:38.333236 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.332275 2528 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mtkvt\"/\"default-dockercfg-82hmq\"" Jun 14 16:07:38.337832 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.337811 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf"] Jun 14 16:07:38.486466 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.486415 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfxdm\" (UniqueName: \"kubernetes.io/projected/823e7a72-292d-41e1-a9c0-a832684b078d-kube-api-access-mfxdm\") pod \"perf-node-gather-daemonset-7k8pf\" (UID: \"823e7a72-292d-41e1-a9c0-a832684b078d\") " pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:38.486647 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.486496 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/823e7a72-292d-41e1-a9c0-a832684b078d-sys\") pod \"perf-node-gather-daemonset-7k8pf\" (UID: \"823e7a72-292d-41e1-a9c0-a832684b078d\") " pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:38.486647 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.486629 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/823e7a72-292d-41e1-a9c0-a832684b078d-podres\") pod \"perf-node-gather-daemonset-7k8pf\" (UID: \"823e7a72-292d-41e1-a9c0-a832684b078d\") " pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:38.486741 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.486660 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/823e7a72-292d-41e1-a9c0-a832684b078d-proc\") pod \"perf-node-gather-daemonset-7k8pf\" (UID: \"823e7a72-292d-41e1-a9c0-a832684b078d\") " pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:38.486741 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.486677 2528 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/823e7a72-292d-41e1-a9c0-a832684b078d-lib-modules\") pod \"perf-node-gather-daemonset-7k8pf\" (UID: \"823e7a72-292d-41e1-a9c0-a832684b078d\") " pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:38.587486 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.587380 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/823e7a72-292d-41e1-a9c0-a832684b078d-podres\") pod \"perf-node-gather-daemonset-7k8pf\" (UID: \"823e7a72-292d-41e1-a9c0-a832684b078d\") " pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:38.587486 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.587431 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/823e7a72-292d-41e1-a9c0-a832684b078d-proc\") pod \"perf-node-gather-daemonset-7k8pf\" (UID: \"823e7a72-292d-41e1-a9c0-a832684b078d\") " pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:38.587486 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.587454 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/823e7a72-292d-41e1-a9c0-a832684b078d-lib-modules\") pod \"perf-node-gather-daemonset-7k8pf\" (UID: \"823e7a72-292d-41e1-a9c0-a832684b078d\") " pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:38.587765 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.587519 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfxdm\" (UniqueName: \"kubernetes.io/projected/823e7a72-292d-41e1-a9c0-a832684b078d-kube-api-access-mfxdm\") pod \"perf-node-gather-daemonset-7k8pf\" (UID: \"823e7a72-292d-41e1-a9c0-a832684b078d\") " pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:38.587765 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.587581 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/823e7a72-292d-41e1-a9c0-a832684b078d-proc\") pod \"perf-node-gather-daemonset-7k8pf\" (UID: \"823e7a72-292d-41e1-a9c0-a832684b078d\") " pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:38.587765 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.587586 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/823e7a72-292d-41e1-a9c0-a832684b078d-podres\") pod \"perf-node-gather-daemonset-7k8pf\" (UID: \"823e7a72-292d-41e1-a9c0-a832684b078d\") " pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:38.587765 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.587585 2528 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/823e7a72-292d-41e1-a9c0-a832684b078d-sys\") pod \"perf-node-gather-daemonset-7k8pf\" (UID: \"823e7a72-292d-41e1-a9c0-a832684b078d\") " pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:38.587765 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.587730 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/823e7a72-292d-41e1-a9c0-a832684b078d-lib-modules\") pod \"perf-node-gather-daemonset-7k8pf\" (UID: \"823e7a72-292d-41e1-a9c0-a832684b078d\") " pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:38.588004 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.587797 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/823e7a72-292d-41e1-a9c0-a832684b078d-sys\") pod \"perf-node-gather-daemonset-7k8pf\" (UID: \"823e7a72-292d-41e1-a9c0-a832684b078d\") " pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:38.589351 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.589326 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-mbthr_a3edf5cf-6899-4036-9266-284f0fa2eb11/download-server/0.log" Jun 14 16:07:38.595708 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.595681 2528 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfxdm\" (UniqueName: \"kubernetes.io/projected/823e7a72-292d-41e1-a9c0-a832684b078d-kube-api-access-mfxdm\") pod \"perf-node-gather-daemonset-7k8pf\" (UID: \"823e7a72-292d-41e1-a9c0-a832684b078d\") " pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:38.645967 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.645933 2528 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:38.793703 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:38.793673 2528 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf"] Jun 14 16:07:38.795733 ip-10-0-143-112 kubenswrapper[2528]: W0614 16:07:38.795706 2528 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod823e7a72_292d_41e1_a9c0_a832684b078d.slice/crio-2b25de9fba8f6f99783d9d7ca6e44c0d93131e5f8ba0b879ee6c68618548e5da WatchSource:0}: Error finding container 2b25de9fba8f6f99783d9d7ca6e44c0d93131e5f8ba0b879ee6c68618548e5da: Status 404 returned error can't find the container with id 2b25de9fba8f6f99783d9d7ca6e44c0d93131e5f8ba0b879ee6c68618548e5da Jun 14 16:07:39.260704 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:39.260662 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-kcdnc_833c74ce-b24b-426b-b7ec-566319790322/volume-data-source-validator/0.log" Jun 14 16:07:39.705539 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:39.705496 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" event={"ID":"823e7a72-292d-41e1-a9c0-a832684b078d","Type":"ContainerStarted","Data":"8f6882f6f805c8e2f18fbfcbd02cc4128be7e6e1d245689d1c484d6cb85bb37c"} Jun 14 16:07:39.705749 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:39.705549 2528 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" event={"ID":"823e7a72-292d-41e1-a9c0-a832684b078d","Type":"ContainerStarted","Data":"2b25de9fba8f6f99783d9d7ca6e44c0d93131e5f8ba0b879ee6c68618548e5da"} Jun 14 16:07:39.705749 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:39.705619 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:39.722009 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:39.721955 2528 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" podStartSLOduration=1.721939414 podStartE2EDuration="1.721939414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 16:07:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 16:07:39.721334772 +0000 UTC m=+860.650982467" watchObservedRunningTime="2026-06-14 16:07:39.721939414 +0000 UTC m=+860.651587110" Jun 14 16:07:40.249700 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:40.249669 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jb9fb_50821ade-1839-41ad-9c07-4b1316d44359/dns/0.log" Jun 14 16:07:40.289886 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:40.289853 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jb9fb_50821ade-1839-41ad-9c07-4b1316d44359/kube-rbac-proxy/0.log" Jun 14 16:07:40.514472 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:40.514378 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tv4zb_ad18bf63-5cb1-49ed-8747-cf53066d4757/dns-node-resolver/0.log" Jun 14 16:07:41.176416 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:41.176385 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x29bp_192f9064-28fa-4ccc-aae0-e6157e6ac308/node-ca/0.log" Jun 14 16:07:42.142455 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:42.142418 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5zp2s_58b744b4-a692-4459-9b5f-7ae25a677aeb/discovery/0.log" Jun 14 16:07:42.187595 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:42.187558 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d56d8dc9f-f5nzd_59970e23-03fa-4641-afd5-560a91675fcb/kube-auth-proxy/0.log" Jun 14 16:07:42.805103 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:42.805075 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bpcbr_28eb3a88-ed18-482b-b2a5-3f43b1991ff5/serve-healthcheck-canary/0.log" Jun 14 16:07:43.343401 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:43.343367 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-hsvlk_26897061-21eb-4b9e-a798-f8d22f6005a5/insights-operator/1.log" Jun 14 16:07:43.343856 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:43.343807 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-hsvlk_26897061-21eb-4b9e-a798-f8d22f6005a5/insights-operator/0.log" Jun 14 16:07:43.431649 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:43.431618 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fwthx_df19f877-e7c4-42d3-a64d-72aa5bee885f/kube-rbac-proxy/0.log" Jun 14 16:07:43.450496 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:43.450460 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fwthx_df19f877-e7c4-42d3-a64d-72aa5bee885f/exporter/0.log" Jun 14 16:07:43.486703 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:43.486665 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fwthx_df19f877-e7c4-42d3-a64d-72aa5bee885f/extractor/0.log" Jun 14 16:07:45.724927 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:45.724897 2528 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mtkvt/perf-node-gather-daemonset-7k8pf" Jun 14 16:07:45.777303 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:45.777276 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6cc8f74cbf-tr6dh_efb9efd2-6d01-4c5a-86b1-e14cd88eb234/nginx/0.log" Jun 14 16:07:45.800637 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:45.800605 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-z726v_900b1f9f-db30-4d6a-ad0a-d73d70fa09b9/manager/0.log" Jun 14 16:07:45.828178 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:45.828143 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-7fbzc_9b34a062-4bc4-414e-81d2-dfef087c886f/manager/0.log" Jun 14 16:07:45.896051 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:45.896026 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-85cpb_581cd7bb-0c45-4d34-afff-2d7f81bd1db1/server/0.log" Jun 14 16:07:45.960752 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:45.960717 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-4v4wf_f01adee1-5764-4ed5-b545-0c2d9a7e18d7/manager/0.log" Jun 14 16:07:46.081844 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:46.081753 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6669f54779-b2drp_fa0f63df-8bb6-4536-a575-628a5d56085b/manager/0.log" Jun 14 16:07:46.099795 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:46.099769 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6669f54779-b2drp_fa0f63df-8bb6-4536-a575-628a5d56085b/copy-manifests/0.log" Jun 14 16:07:46.171815 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:46.171784 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-wqpfq_08b450e2-e5de-48cf-a206-3d7c55233faa/postgres/0.log" Jun 14 16:07:47.893786 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:47.893753 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-xc9sk_641b0995-49e2-47d6-b2a9-964a9ab0e872/openshift-lws-operator/0.log" Jun 14 16:07:52.608182 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:52.608143 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5zp2s_58b744b4-a692-4459-9b5f-7ae25a677aeb/discovery/0.log" Jun 14 16:07:52.639113 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:52.639076 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d56d8dc9f-f5nzd_59970e23-03fa-4641-afd5-560a91675fcb/kube-auth-proxy/0.log" Jun 14 16:07:53.423665 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:53.423620 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-5v2h6_ecd58d5a-c77a-4130-9a10-b8869428bf6d/kube-storage-version-migrator-operator/1.log" Jun 14 16:07:53.425642 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:53.425607 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-5v2h6_ecd58d5a-c77a-4130-9a10-b8869428bf6d/kube-storage-version-migrator-operator/0.log" Jun 14 16:07:53.732101 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:53.732018 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5zp2s_58b744b4-a692-4459-9b5f-7ae25a677aeb/discovery/0.log" Jun 14 16:07:53.758589 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:53.758556 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d56d8dc9f-f5nzd_59970e23-03fa-4641-afd5-560a91675fcb/kube-auth-proxy/0.log" Jun 14 16:07:54.714764 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:54.714734 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbxp5_07d6f6c8-b332-424e-b657-0a6cfe599959/kube-multus-additional-cni-plugins/0.log" Jun 14 16:07:54.736582 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:54.736540 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbxp5_07d6f6c8-b332-424e-b657-0a6cfe599959/egress-router-binary-copy/0.log" Jun 14 16:07:54.758110 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:54.758083 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbxp5_07d6f6c8-b332-424e-b657-0a6cfe599959/cni-plugins/0.log" Jun 14 16:07:54.781204 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:54.781167 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbxp5_07d6f6c8-b332-424e-b657-0a6cfe599959/bond-cni-plugin/0.log" Jun 14 16:07:54.801306 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:54.801265 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbxp5_07d6f6c8-b332-424e-b657-0a6cfe599959/routeoverride-cni/0.log" Jun 14 16:07:54.820820 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:54.820793 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbxp5_07d6f6c8-b332-424e-b657-0a6cfe599959/whereabouts-cni-bincopy/0.log" Jun 14 16:07:54.843558 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:54.843524 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbxp5_07d6f6c8-b332-424e-b657-0a6cfe599959/whereabouts-cni/0.log" Jun 14 16:07:55.032702 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:55.032601 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dl45m_8d1ec93e-24ee-451f-a4bd-cb8281280b21/kube-multus/0.log" Jun 14 16:07:55.157281 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:55.157250 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t5kjf_36c343bd-9776-45d6-9fd4-6994edafd550/network-metrics-daemon/0.log" Jun 14 16:07:55.176325 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:55.176294 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t5kjf_36c343bd-9776-45d6-9fd4-6994edafd550/kube-rbac-proxy/0.log" Jun 14 16:07:55.269936 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:55.269899 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5zp2s_58b744b4-a692-4459-9b5f-7ae25a677aeb/discovery/0.log" Jun 14 16:07:55.296722 ip-10-0-143-112 kubenswrapper[2528]: I0614 16:07:55.296627 2528 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d56d8dc9f-f5nzd_59970e23-03fa-4641-afd5-560a91675fcb/kube-auth-proxy/0.log"